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PREFACE 

This  \ianAho6k,  Reliability  Measurement,  is  the  third  in  a series  of  five  on 
reliability.  The  series  is  directed  largely  toward  the  working  engineers  who 
have  the  responsibility  for  creating  and  producing  equipment  and  systems 
which  can  be  relied  upon  by  the  users  in  the  field. 

The  five  handbooks  are: 

1 . Design  far  Reliability . AMCP  706-196 

2.  Reliability  Prediction,  AMCP  706-197 

3.  Reliability  Measurement,  AMCP  706-198 

4.  Contractingf  or  Reliability.  AMCP  706-199 

5.  Mathematical  Appendix  and  Glossary,  KMC?  106-1G0. 

This  handbook  is  directed  toward  reliability  engineers  who  need  to  be 
familiar  with  statistical  analysis  of  experimental  results,  with  reliability-test 
management  and  planning,  and  with  integrated  reliability-data  systems. 

Many  examples  are  used,  especially  to  illustrate  the  statistical  analysis.  Refer- 
ences are  given  to  the  literature  for  further  information. 

The  majority  of  the  handbook  content  was  obtained  from  many  individu- 
als, reports, journals,  books,  and  other  literature.  It  is  impractical  here  to 
acknowledge  the  assistance  of  everyone  who  made  a contribution. 

The  original  volume  was  prepared  by  Tracer  Jitco,  Inc.  The  revision  was 
prepared  by  Dr.  Ralph  A.  Evans  of  Evans  Associates,  Durham,  NC,  for  the 
Engineering  Handbook  Office  of  the  Research  Triangle  Institute,  prime  con- 
tractor to  the  US  Army  Materiel  Command.  Technical  guidance  and  coordi- 
nation on  the  original  draft  were  provided  by  a committee  under  the  direc- 
tion of  Mr.  0.  P.  Bruno,  Army  Materiel  System  Analysis  Agency,  US  Army 
Materiel  Command. 

The  Engineering  Design  Handbooks  fall  into  two  basic  categories,  those 
approved  for  release  and  sale,  and  those  classified  for  security  reasons.  The 
US  Army  Materiel  Command  policy  is  to  release  these  Engineering  Design 
Handbooks  in  accordance  with  current  DOD  Directive  7230.7,  dated  18  Sep- 
tember 1973.  All  unclassified  Handbooks  can  be  obtained  from  the  National 
Technical  Information  Service  (NTIS).  Procedures  for  acquiring  these  Hand- 
books follow : 

a.  All  Department  of  Army  activities  having  need  for  the  Handbooks  must 
submit  their  request  on  an  official  requisition  form  (DA  Form  17,  dated 
Jan  70)  directly  to: 


Commander 

Letterkenny  Anny  Depot 


ATTN:  AMXLE-ATD 
Chambersburg,  PA  17201 
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(Requests  for  classified  documents  must  be  submitted,  with  appropriate 
“Need  to  Know” justification,  to  Letterkenny  Army  Depot.)  DA  activities 
will  not  requisition  Handbooks  for  further  free  distribution. 

b.  All  other  requestors,  DOD,  Na\y,  Air  Force,  Marine  Corps,  nonmilitary 
Government  agencies,  contractors,  private  industry,  individuals,  universities, 
and  others  must  purchase  these  Handbooks  from : 

National  Technical  Information  Service 
Department  of  Commerce 
Springfield,  VA  22151 

Classified  documents  may  be  released  on  a “Need  to  Know”  basis  verified  by 
an  official  Department  of  Army  representative  and  processed  from  Defense 
Documentation  Center  (DDC),  ATTN:  DDC-TSR,  Cameron  Station,  Alexan- 
dria, VA  22314. 

Comments  and  suggestions  on  this  Handbook  are  welcome  and  should  be 
addressed  to: 


Commander 

US  Army  Materiel  Development  and  Readiness  Command 
Alexandria,  VA  22333 
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CHAPTER  1 
INTRODUCTION 


1-1  GENERAL 

Reliability  measurement  techniques  provide 
a common  discipline  that  can  be  used  to 
make  system  reliability  projections  through- 
out the  life  cycle  of  a system.  The  data  on 
component  and  equipment  failures  obtained 
during  the  reliability  measurement  program 
can  be  used  to  compute  component  failure 
distributions  and  equipment  reliability  char- 
acteristics. Reliability  measurement  tech- 
niques are  used  during  the  research  and 
development  phase  to  measure  the  reliability 
of  components  and  equipments  and  to  eval- 
uate the  relationships  between  applied  stresses 
and  environments  and  reliability.  Later  in  a 
system  life  cycle,  reliability  measurement  and 
testing  procedures  can  be  used  to  demonstrate 
that  contractually  required  reliability  levels 
have  been  met. 

Uniform  criteria  for  establishing  a reliabil- 
ity measurement  program  are  defined  in 
MlL-STD-785  (Ref  1).  These  standards  must 
be  incorporated  into  Department  of  Defense 
procurements  of  all  systems  that  undergo 
contract  definition.  If  a system  does  not  re- 
quire a contract  definition  effort,  they  can  be 
incorporated  in  the  request  for  proposal 
(RFP). 

The  Army  has  developed  a number  of  reg- 
ulations, complementing  MlL-STD-785,  which 
establish  reliability  as  a major  parameter 
which  must  be  measured  during  the  develop- 
ment of  a new  weapon  system  (Refs.  2,  3, 
and  4).  All  Army  materiel  ought  to  be  phys- 
ically tested  to  determine  whether  the  design 
requirements,  including  reliability,  have  been 
met.  Testing  is  performed  under  the  direction 


of  the  appropriate  AMC  commodity  com- 
mands, project  managers,  and  installations  or 
activities  which  report  directly  to  Head- 
quarters AMC. 

The  US  Army  Test  and  Evaluation  Com- 
mand (USATECOM)  is  responsible  for  review- 
ing test  documentation  produced  by  other 
Army  organizations.  USATECOM  can,  at  its 
own  discretion,  conduct  independent  tests 
and  evaluations  on  any  Army  developed  sys- 
tem (Ref  5).  The  reliability  measurement 
techniques  described  in  this  volume  are  con- 
sistent with  Army  Regulations  and  can  be 
applied  directly  to  systems  developed  under 
Army  auspices. 

A reliability  measurement  system  consists 
of  two  major  functional  divisions:  (1)  the 
test  program,  and  (2)  the  data  system. 

The  test  program  provides  a comprehensive 
test  effort  that  ensures  that  reliability  goals 
are  met.  A test  schedule  that  designates  when 
test  procedures,  test  samples,  and  necessary 
equipment  and  facilities  will  be  required  must 
be  developed.  Procedures  for  gathering  the 
data,  which  will  be  generated  throughout  all 
phases  of  the  test  program,  must  be  docu- 
mented in  sufficient  detail  for  complete  iden- 
tification and  integration  into  the  data  process- 
ing system. 

The  integrated  data  system  establishes  pro- 
cedures for  accumulating,  coding,  and  handling 
data.  Standard  data  accumulation  require- 
ments (and  compatible  data  sheets)  provide 
for  collecting  and  recording  data  such  as 
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identifying-information,  environmental  con- 
ditions, operating  hours  or  cycles,  and  failures. 

1-2  RELIABILITY  TEST  PROGRAM 

Testing  is  an  important  and  expensive  part 
of  the  development  program  for  an  equip 
ment  or  system.  Because  reliability  testing  is 
expensive,  the  test  program  must  be  designed 
carefully  to  fit  into  the  overall  development 
program. 

The  information  provided  by  a reliability 
test  program  can  be  used  at  any  point  in  the 
system  life  cycle.  A well  planned  program  of 
functional  environmental  testing  must  be  con- 
ducted during  system  design  and  development 
in  order  to  achieve  the  required  reliability 
and  to  provide  data  for  improving  reliability. 
These  tests  are  used  to  measure  the  reliability 
of  components,  equipments,  and  subsystems 
used  in  a system.  , Tests  also  are  used  to  de- 
sign tools  to  evaluate  the  relationship  between 
various  environments  and  stresses,  and  reliabil- 
ity. The  reliability  tests  performed  during 
development  answer  the  basic  question  of 
whether  or  not  the  design  really  works. 

A reliability  measurement  program  must 
be  planned  carefully.  The  contractor  develop- 
ing a system  must  prepare  an  integrated  test 
plan  that  includes  all  reliability  tests  to  be 
performed  during  the  program.  The  tests 
must  be  designed  to  make  maximum  use  of 
all  data  produced  on  the  program.  The  reli- 
ability test  program  must  be  integrated  with 
other  system/equipment  test  programs  in 
order  to  minimize  wasted  effort.  A number 
of  standard  test  plans  have  been  developed 
to  guide  contractors  and  Army  project  man- 
agers (Refs.  6,  7,  and  8).  The  test  plans  in 
MlL-STD-781  can  be  used  for  testing  equip- 
ments and  systems  whose  failure  characteristics 
are  governed  by  the  exponential  distribution. 
The  sampling  plans  described  in  MlL-STD-105 
can  be  used  for  1-shot  devices.  Modifications 
of  the  procedures  in  MlL-STD-105  for  com- 
ponents governed  by  a Weibull  distribution  are 
described  in  TR-7  (Ref.  4). 


After  the  design  is  established,  reliability 
tests  can  be  used  to  make  decisions  about 
system  reliability  and  to  determine  if  reli- 
ability goals  have  been  met.  The  procedures 
described  in  this  volume  can  be  applied  to  a 
variety  of  situations.  The  tests  range  from 
quality-assurance  tests,  which  are  performed 
at  the  part  level  on  lots  of  components,  to 
reliability  demonstration  tests  used  to  prove 
that  a system  indeed  meets  its  reliability 
requirements. 

Demonstration  tests  on  systems  can  be  per- 
formed in  three  distinct  phases: 

1.  Specific  subsystems  and  equipments 
must  be  tested  to  determine  if  they  meet  the 
reliability  requirements  allocated  to  them,. 

The  equipments  must  be  evaluated  in  a con- 
trolled environment  in  which  performance  is 
monitored  by  means  of  an  instrumented  test 
set-up.  Equipments  that  do  not  meet  reli- 
ability requirements  must  be  redesigned. 

2.  After  individual  equipments  have  been 
tested,  they  must  be  mated  and  the  entire 
system  must  be  subjected  to  realistic  opera- 
tional procedures  and  environments.  Reli- 
ability data  are  gathered  by  means  of  a care- 
fully organized  data  reporting  system. 

3.  Operational  testing  must  be  performed 
by  Army  personnel  who  exercise  the  system 
in  the  operational  environment.  Reliability 
data  are  gathered  along  with  many  other  data 
items.  These  tests  permit  the  reliability  per- 
formance of  Army  systems  to  be  determined 
in  realistic  operating  environments,  and  they 
may  uncover  weaknesses  masked  in  the  pre- 
vious tests. 

Achieved  reliability  must  be  demonstrated 
formally  at  specified  times  during  the  pro- 
gram. Demonstration  testing  must  be  per- 
formed at  the  system  level,  and  at  the  sub- 
system and  equipment  levels.  Demonstration 
test  plans  must  include  a definition  of  failure 
criteria,  applied  environments  and  stresses, 
test  procedures,  and  the  applicable  statistical 
test  plans. 
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The  techniques  of  mathematical  statistics 
are  used  extensively  in  reliability  testing. 

These  techniques  provide  the  tools  that  relate 
sample  size,  test  duration,  s-confidence  levels, 
stress  levels,  and  other  factors.  They  are 
discussed  in  Chapters  2 and  3,  and  in  Part 
Six,  Mathematical  Appendix  and  Glossary. 

Chapter  4 will  describe  techniques  and  pro- 
cedures which  can  be  applied  to  reliability 
test  planning  and  management  to  ensure  a 
more  efficient  test  program. 


1-3  INTEGRATED  DATA  SYSTEM 

An  integrated  data  system  can  be  used  to 
provide  project  managers  and  engineers  with 
the  data  that  they  need  in  order  to  monitor 
the  reliability  achieved  by  the  system  and  its 
component  parts.  If  provided  in  a timely 
manner,  this  information  can  be  used  for 
effective  planning,  review,  and  control  of 
actions  related  to  system  reliability.  The 
data  system  ought  to  encompass  the  follow- 
ing characteristics: 

1.  Be  a closed-loop  system  for  collecting, 
analyzing,  and  recording  all  failures  that 
occur  during  system  development. 

2.  Provide  data  that  can  be  used  to  esti- 
mate reliability  and  to  indicate  needed  cor- 
rective action.  All  hardware  failures  should 
be  recorded  with  information  about  the 
failed  component,  time  of  failure,  cause  of 
failure,  and  other  pertinent  information. 

3.  Develop  computer  programs  that  per- 


T  MIL-STD-785,  Reliability  Program  fox 
Systems  and  Equipment  Development 

and  Production. 

2.  AMCR  11-1 , Research  and  Develop- 
ment, Systems  Analysis. 


mit  the  printing  of  reliability  status  output 
reports. 

4.  Develop  and  standardize  procedures  for 
data  accumulation  and  reduction.  These 
standard  procedures  must  provide  for  the 
collection  of  data,  the  recording  of  identify- 
ing information,  environmental  conditions, 
operating  hours  or  cycles,  and  hardware 
failures  on  each  test  performed. 

5.  Be  structured  to  make  use  of  data 
recorded  on  failures  that  occur  at  times  other 
than  the  reliability  tests. 

6.  Handle,  process,  and  integrate  all  data 
obtained  from  testing,  inspection,  and  failure 
trouble  reporting.  These  data  can  be  used 
for  reliability  analysis  and  reporting,  assess- 
ment of  equipment  readiness,  and  a variety 
of  other  purposes. 

7.  Maintain  and  update  a computer  data 
bank  of  accumulated  reliability  data.  These 
data  can  be  processed  to  produce  reliability 
status  reports  that  present  a summary  of 
failure  rates  and  reliability  parameters  for 
components,  equipments,  and  subsystems. 
These  reports  can  be  structured  to  list  the 
troublesome  items  that  are  causing  the  most 
serious  reliability  difficulties.  They  can  be 
distributed  to  cognizant  Army  and  contractor 
engineers  and  managers. 

A detailed  description  of  an  integrated 
data  system  is  presented  in  Chapter  5. 
Chapters  6,  7,  and  8 describe  environmental 
testing,  accelerated  testing,  and  nondestructive 
testing,  respectively. 


3.  AR  702-3,  Product  Assurance:  Army 
Materiel  Reliability,  Availability,  and 
Maintainability  (RAM). 

4.  TR-7,  Factors  and  Procedures  fox  Apply- 
ing MIL-STD-1  OSD  Sampling  Plans  to 
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Life  and  Reliability  Testing,  OW\ct  oi  6.  MIL-STD-781,  Tests:  Ex- 

the  Assistant  Secretary  of  Defense  for  ponential  Distribution. 

Installations  and  Logistics.  Available 

from  NTIS.  7.  MIL-STD-105,  Sampling  Procedures  and 

Tables  far  Inspection  by  Attributes. 

5.  USATECOM  Pamphlet  700-700, 

USATECOM Materiel  Test  Procedures. 
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CHAPTER  2 

STATISTICAL  EVALUATION  OF  RELIABILITY  TESTS,  DESIGN 
AND  DEVELOPMENT 


LIST  OF  SYMBOLS 


B 

- function  of  j3  in  lognormal 

i 

- 

an  integer  in  Example  No. 

distribution,  see  par.  2-3.6 

10  (cell  boundary  number) 

c 

= acceptance  number  (for 

k 

= 

number  of  events 

sampling);  number  of  cycles 

*/ 

_ 

number  of  trials  with 

Ci 

= s-confidence  limit 

result  i 

Cdf 

= Cumulative  distribution  func- 

K-S 

= 

critical  value  in  a K-S  test 

tion,  Cdf{x\  =/V(Y<x} 

(see  Table  2-13) 

Conf { • } 

= s-confidence  that  the  state- 

L, U 

= 

subscripts  meaning  Lower 

ment  in  the  { •)  is  true 

and  Upper 

Cov  { • } 

= Covariance 

m,  b 

= 

slope  and  intercept  for>!, 
see  par.  2-8 

csqfiit}  ;vj 

= Cdf  of  chi-square  distribu- 

tion with  V degrees  of 

Ho,  «e 

see  Eqs.  2-43  and  2-44 

freedom 

N 

sample  size 

csqfc  (x^  ; v) 

= complement  of  csqf  (x^  ; J'), 

csqf  (x^ ; i')  = 

0 

= 

subscript,  implies  a fixed 

£|.| 

1 - csqf  (x^  ; i') 

value-not  a random 
variable 

= sexpected  value,  mean 

OC 

Operating  Characteristic 

F 

= a Cdf ;the  F-statistic 

Pi 

— 

probability  of  result  i (con- 

gauf (z) 

= Cdf  of  Gaussian  (s-normal) 

stant  from  trial  to  trial) 

distribution 

Pk,N 

r: 

k-th  from  N order- statistic 

gaufc  (z) 

= complement  o^gauf  (z), 

gaufc  (z)=  \ -gauf  (z) 

pdf 

= 

probability  density  function 

H 

= cumulative  hazard. 

poif  ii;p) 

= 

Cdf  of  the  Poisson  distribu- 

Sf = exp  {—H) 

tion  (mean  is  g) 
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pcdm 

= pmf  of  the  Poisson  distribu- 

a 

- scale  parameter;  producer 

tion  (mean  is  m) 

risk 

pmf 

= probability  mass  function 

0 

= shape  parameter;  consumer 

risk 

PP 

= plotting  position 

r 

= gamma  function 

r 

= number  of  failures 

8 

= a difference  associated  with 

R 

= an  5/ 

a sample,  see  par.  2-9 

s- 

implies  the  word  “statisti- 
cal(ly)”,  or  implies  that  the 

E 

= standard  s-normal  variate 

technical  statistical  defini- 

V 

= coefficient  of  variation. 

tion  is  intended  rather  than 

•a 

III 

<3 

the  ordinary  dictionary 
definition 

d 

= exponential  scale  parameter; 

mean  time  to  failure 

= SS/i',  variance  estimate 

A 

= Poisson  rate  parameter; 

S/ 

= ilN,  basic  plotting  position. 

failure  rate 

see  par.  2-5 

= mean  ; also  location-para- 

Sf 

= Survivor  function. 

meter  of  s-normal  distribu- 

Sf\x\ = Pr{X>  x\ 

tion 

ss 

= sum  of  squares 

V 

= degrees  of  freedom 

t 

= time;  time-to-failure; 

p 

= linear  correlation  coefficient 

Student  t variable 

a 

= standard  deviation;  also 

T 

/ 1 

= total  test  time 

scale-parameter  of  s-normal 
distribution 

Varj*  1 

= Variance,  square  of  standard 

deviation 

<t> 

= fraction  of  mission  time. 

see  Eq.  2-68 

w^//(u;  j3) 

= Cdfof  the  standard  Weibull 

distribution  (shape  parameter 

= a random  variable  which 

is  |3) 

has  the  chi-square  distribu- 
tion 

X 

= random  variable 

= same  as  > but  implies  the 

X 

= mean  of  a sample  of  x’s 

associated  degrees  of  freedom 

= see  Eqs.  2-43  and  2-44 

= same  as  x?,  but  also  implies 

the  probability  {Cdf)  as- 

Y 

= a linear  function  cf  x,  see 

sociated  with  that  value  of 

par.  2-8 

X^  viz.,  csqf(xly,y)  =p. 
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implies  the  value  before  a 
shift  of  the  origin,  see 
par.  2-8 

implies  an  estimated  value 
of  the  parameter 

2-1  INTRODUCTION 

The  main  advantage  of  statistics  is  that  it 
can  provide  a good  measure  of  the  uncer- 
tainty involved  in  a numerical  analysis.  The 
secondary  advantage  is  that  it  does  provide 
methods  for  estimating  effects  that  might 
otherwise  be  lost  in  the  random  variations 
in  the  data.  Wherever  possible  in  the  ex- 
amples in  this  chapter,  the  uncertainty  in  the 
numerical  results  will  be  emphasized. 

Rarely  is  an  engineer  interested  only  in 
the  results  of  analyzing  his  model.  The 
engineer  must  solve  a real-world,  not  a math- 
ematical, problem.  The  answer  to  the  math- 
ematical problem  must  be  tempered  by  all 
the  other  important  considerations  that  never 
found  their  way  into  the  model;  this  is  why 
the  estimation  of  uncertainty  is  so  important. 
The  engineer  needs  to  know  how  much  he 
can  afford  to  be  swayed  by  those  other  con- 
siderations. 

A well  designed  and  properly  executed 
reliability  test  program  provides  useful  data 
for  system  designers  and  managers.  The 
statistical  tests  described  in  this  chapter  can 
be  used  to  help  ensure  that  the  system  de- 
sign meets  reliability  requirements.  A de- 
scription of  the  basic  concepts  of  statistical 
testing  during  system  design  and  develop- 
ment is  presented  in  this  chapter. 

Reliability  test  and  measurement  are  among 
the  most  important  parts  of  a design  and 
development  program  (Ref.  1).  During  de- 
sign and  development,  tests  are  performed 
to: 

1.  Measure  the  reliability  of  equipments 
and  subsystems  (measurement  tests) 


2.  Evaluate  the  relationships  between 
applied  environments  and  stresses  and  reli- 
ability (evaluation  tests) 

3.  Verify  that  an  item  meets  a prescribed 
minimum  reliability  (tests  of  verification) 

4.  Select  the  more  reliable  unit  or 
approach  from  several  alternatives  (tests  of 
comparison). 

Reliability-measurement  tests  must  be  con- 
ducted under  controlled  conditions  that 
approximate  those  to  which  the  equipment 
will  be  subjected  in  the  field  (Ref  2).  Op 
erating  times  and  number  of  failures  are 
accumulated  and  used  to  estimate  the  under- 
lying failure  distribution,  the  reliability,  and 
level  of  s-confidence  of  the  results. 

Evaluation  tests  provide  estimates  of  the 
relationships  between  failures,  and  applied 
environments  and  stresses.  Numerical  rela- 
tionships between  failure  rate  (and  reli- 
ability) and  specific  stresses  can  be  derived. 

In  addition,  the  relative  effects  of  each  en- 
vironment in  a multienvironment  situation 
ean  be  estimated  using  techniques  such  as 
Analysis  of  Variance  and  Multiple  Regression. 

Tests  of  verification  are  used  to  verify  that 
a desired  result  has  been  obtained  (Ref  2). 

A hypothesis  such  as  “the  reliability  is  equal 
to  or  greater  than  0.95  for  500  hr  of  opera- 
tion” or  “the  failure  rate  is  equal  to  or  less 
than  0.02  per  1000  hr”  is  tested.  The  test 
hypothesis  is  then  verified  at  some  level  of 
s-significance  by  the  test  results.  A wide 
variety  of  tests  can  be  designed— depending 
on  the  number  of  units  tested,  the  time 
allowed  for  testing,  and  the  level  of  risks 
taken  in  accepting  the  results. 

Frequently,  alternate  design  approaches 
are  available  to  the  system  designer.  Tests 
of  comparison  permit  the  designer  to  com- 
pare their  reliability.  The  basic  hypothesis  of 
this  kind  of  test  is  that  “no  difference  exists 
between  the  reliabilities”.  This  hypothesis  is 
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tested  against  the  hypothesis  that  “the  reli- 
abilities are  not  equal”.  These  tests  provide 
useful  guidance  to  equipment  designers  who 
can  then  make  decisions  based  on  test  results 
and  rigorous  statistical  analyses. 

The  tests  must  be  well  planned  and  test 
data  properly  evaluated  in  order  to  avoid 
costly  errors  and  delays.  This  is  especially 
true  for  system  reliability  testing  in  which 
components  frequently  are  destroyed  and  in 
which  expensive  equipment  must  be  built  to 
simulate  the  operational  environment.  Test 
planning  is  very  important  in  complex  pro- 
grams that  operate  under  time  and  budget 
limitations.  Critical  trade-offs  must  be  made 
among  test  time,  number  of  units  tested,  and 
achieved  s -confidence  level. 

Reliability  measurement  tests  are  used  to 
make  estimates  of  the  reliability  of  a popula- 
tion of  items.  Both  parametric  and  nonpara- 
metric  estimates  can  be  used.  Parametric 
estimates  are  based  on  a known  or  assumed 
distribution  of  the  characteristic  of  interest. 
The  constants  in  the  equation  that  describe 
the  probability  distribution  are  called  para- 
meters. Nonparametric  estimates  are  made 
without  assuming  any  particular  form  for 
the  probability  distribution. 

The  three  types  of  parametric  estimates 
most  frequently  used  are  (Ref  3): 

1.  Point  estimate— a single-valued  estimate 
of  a reliability  parameter 

2.  Interval  estimate— an  estimate  of  an 
interval  that  is  believed  to  contain  the  true 
value  of  the  parameter 

3.  Distribution  estimate— an  estimate  of 
the  parameters  of  a reliability  distribution. 

A s-confidence  interval  estimate  is  one  for 
which  there  is  a known  probability  that  the 
true  value  of  the  unknown  parameter  or 
characteristic  lies  within  a computed  inters  al. 


s-Confidence  interval  estimates  are  more  use- 
ful than  point  estimates  because  they  give  a 
much  better  idea  of  the  uncertainty  involved 
in  the  estimation  process. 

Distribution  estimates  are  used  when  it  is 
desired  to  estimate  the  probability  distribu- 
tion governing  a particular  reliability  measure. 
This  is  usually  a 2-step  process:  (1)  the  form 
of  the  distribution  must  be  hypothesized  or 
determined  from  the  failure  data,  and  (2)  the 
parameters  that  describe  the  distribution 
must  be  estimated. 

Nonparametric  methods  can  be  used  to 
estimate  reliability  measures  without  making 
any  assumptions  concerning  the  time-to- 
failure  distribution.  Generally,  nonparametric 
estimates  are  not  as  efficient  as  parametric 
estimates.  Nonparametric  reliability  estimates 
apply  only  to  the  specific  test  interval  and 
cannot  be  extrapolated.  Both  point  estimates 
and  interv  al  estimates  can  be  made  using  non- 
parametric techniques. 

Before  one  decides  to  choose  a type  of 
distribution  and  estimate  its  parameters  from 
the  data,  one  should  have  a very  good  idea 
of  why  it  is  being  done.  For  example,  one 
may  wish  to  use  it  to  interpolate  among  the 
data,  one  may  wish  to  extrapolate,  or  one 
may  wish  to  estimate  certain  characteristics 
of  the  data  such  as  a mean,  median,  or  tenth 
percentile.  If  one  is  going  to  use  the  distribu- 
tion to  interpolate  among  the  data,  goodness- 
of-fit  tests  are  quite  appropriate  to  help  de- 
termine a good  type  of  distribution  to  use. 

If  one  is  going  to  extrapolate,  then  goodness- 
of-fit  tests  (which  operate  only  in  the  region 
of  the  data)  are  not  appropriate  because  they 
do  not  tell  how  well  the  distribution  will  fit 
in  the  region  where  there  are  no  data;  in 
fact,  goodness-of-fit  tests  for  this  purpose  can 
be  extremely  misleading. 

If  the  purpose  of  knowing  the  distribution 
is  to  estimate  some  characteristics  of  the 
population,  one  should  give  serious  considera- 
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tion  to  calculating  the  corresponding  sample 
property  and  using  that  directly  to  estimate 
the  population  property.  It  is  essentially  a 
distribution-free  method  and  is  not  subject 
to  errors  caused  by  the  distribution  not 
fitting  the  population  out  in  the  tail  region 
where  there  are  no  data.  Goodness-of-fit 
tests  for  this  purpose  are  appropriate  if  the 
only  property  of  the  distribution  that  is 
being  used  is  one  inside  the  data.  It  is  quite 
inappropriate  if  properties  of  the  distribution 
outside  the  data  are  used,  for  example,  in 
calculating  a mean. 

2-2  GRAPHICAL  ESTIMATION  OF 

PARAMETERS  OF  A DISTRIBUTION 

The  underlying  distribution  governing  the 
reliability  characteristics  should  be  chosen 
carefully,  because  the  validity  of  the  reli- 
ability predictions  and  tests  depends  on  this 
selection.  Although  the  exponential  distribu- 
tion is  most  common  for  electronic  equip- 
ments, other  distributions  are  used.  The 
failure  characteristics  of  electromechanical 
and  mechanical  systems  often  can  be  de- 
scribed by  distributions  such  as  the  s-normal, 
lognormal,  or  Weibull.  Computer  programs 
are  available  for  estimating  the  parameters 
for  an  assumed  distribution  from  a set  of 
data.  In  many  practical  cases,  graphical 
techniques  are  simple  to  apply  and  produee 
adequate  results  for  estimating  the  underlying 
distribution.  They  are  virtually  always  a 
useful  preliminary  to  analytic  estimation. 

The  basic  idea  in  developing  special  graph 
paper  for  use  in  graphical  analysis  is  to  have 
the  population  Cdf  or  its  cumulative  hazard 
plot  as  a straight  line,  A straight  line  has  2 
parameters  (slope  and  intercept);  so  2 para- 
meters for  the  distribution  can  be  determined, 
if  the  distribution  can  be  appropriately  trans- 
formed. 

Graphical  curve  fitting  techniques  have 
been  developed  for  all  of  the  distributions 
commonly  associated  with  reliability  testing 


(Refs.  3,  4,  5,  22,  and  23).  Procedures  for 
the  s-normal,  lognormal,  and  Weibull  distribu- 
tions are  quite  simple  to  apply,  and  are  illus- 
trated in  the  remainder  of  this  paragraph. 

In  graphical  methods,  the  data  from  the 
sample  are  rearranged  so  that  they  are  in 
order  from  smallest  to  largest;  they  are  then 
referred  to  as  order-statistics.  Occasionally 
the  order  is  from  largest  to  smallest,  but 
since  it  is  so  rarely  done  in  reliability  work, 
all  illustrations  will  be  in  the  usual  way.  In 
order  to  plot  the  data  points,  a method  is 
needed  for  choosing  the  Cdf  (or  the  equiv- 
alent cumulative  hazard)  at  which  each  point 
is  to  be  plotted.  There  are  several  methods 
for  doing  this;  they  are  explained  in  par.  2-2.1 
and  2-2.2.  There  is  no  clear-cut  way  that  is 
acceptable  to  everyone.  But  some  of  the 
disagreements  are  needless,  for  the  simple 
reason  that  when  the  sample  size  is  small,  the 
inherent  uncertainty  in  plotting  position  is 
very  large  (regardless  of  the  method  used); 
and  when  the  sample  size  is  large,  all  the 
methods  tend  to  give  the  same  position. 
Besides,  if  the  finer  phases  of  parameter 
estimation  by  graphical  methods  are  impor- 
tant to  you,  you  ought  to  be  using  an  ana- 
lytic method  for  those  finer  phases-graphical 
methods  just  don’t  have  the  ability  to  make 
preeise  point  estimates  or  to  estimate  the 
uneertainty  in  those  point  estimates. 

2-2.1  PLOTTING  POSITIONS  (CUMULA- 
TIVE DISTRIBUTION  FUNCTION) 

Two  methods  of  detennining  plotting  posi- 
tion are  described.  Both  require  that  onee 
testing  is  stopped  for  any  nonfailed  item,  it 
be  stopped  for  all  remaining  items.  Likewise, 
neither  ean  use  the  extra  information  if  test- 
ing eontinues  beyond  the  failure  time  of  the 
last  reeorded  item  (this  tends  to  be  true  for 
any  graphieal  method  and  many  analytic 
methods). 

1.  The  sample  Cdf  is  plotted,  and  the 
uneertainty  is  looked-up  in  a simple  table. 
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If  all  items  are  failed,  the  probability  state- 
ments about  the  true  Cdf  (relative  to  the 
sample  points)  are  simple  and  straightforward. 
This  method  is  recommended  whenever  it 
can  be  used. 

2.  The  distribi^tion  of  the  order  statistics 
is  used  to  provide  3 plotting  positions  for 
each  point.  This  spread  provides  a feel  for 
the  uncertainties  involved.  Simple,  straight- 
forward probability  statements  can  be  made 
only  for  an  individual  point,  not  for  the  Cdf 
as  a whole.  Extensive  tables  are  necessary. 

As  mentioned  in  the  first  paragraph,  these 
methods  can  be  used  provided  no  failure 
time  is  longer  than  a censoring  time.  A cen- 
soring (censored  item)  occurs  when  an  item 
is  removed  from  test  before  it  fails.  The 
cause  for  removal  cannot  be  related  to  the 
apparent  condition  of  the  item  if  an  analysis 
in  Chapter  2 is  to  be  valid.  For  example, 
suppose  as  failure  becomes  quite  likely,  an 
item  begins  to  vibrate  slightly.  Then  if  items 
that  vibrate  are  removed  from  test  before 
they  actually  fail,  the  removal  cause  is  related 
to  the  condition  of  the  item;  and  a legitimate 
analysis  of  test  results  is  virtually  impossible 
unless  the  whole  test  and  population  descrip- 
tion are  redefined. 

2-2.1. 1 Practical  Plotting  (K-S  Bounds) 

Specific  instructions  for  this  kind  of 
plotting  are  on  the  back  of  each  sheet  of 
Practical  Probability  Paper  in  par.  2-2.  They 
are  repeated  here  for  a general  case. 

Notation: 

F = Cumulative  distribution  function  {Cdf) 

n = sample  size 

r - failure  number;  r = 1 ,2,  . . . , « 

Plotting  instructions  follow: 

1.  Plotting  data:  plot  failure  r at  the 
two  points 


HI  = r/n 

(2-la) 

Lo  = (r  — l)/n 

(2-lb) 

Connect  the  points  with  horizontal  and  verti- 
cal lines;  this  is  the  sample  Cdf. 

2.  2-sided  s-confidence  bounds  on  the 
actual  Cdf'.  choose  the  s-confidence  level, 
near  [1  —(!/«)]  is  reasonable;  then  find  KS, 
from  the  body  of  Table  2- 1(A)  (e.g.,  77  = 10, 
s-confidence  = 95%,  KS,  = 0.41).  The  upper 
bound  is  plotted  at 

Flo  + KS,  and  Fhi  + KS„  ; (2-2a) 

the  lower  bound  is  plotted  at 

Fhi  “•  KS,  and  Flo  — KS,  . (2-2b) 

For  each  bound,  connect  the  points  with 


TABLE  2-1  (A) 
TABLE  OF  K-S  BOUNDS 


n KS,  (s-confidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

.47 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

.21 

.24 

.25 

n 

1.22 

1.36 

1.52 

1.63 

\4hT 

Vn+1 

y/n+T 

Vn+1 

(formula  is  o.k.  for  n>6) 


For  censored  samples,  use  an  n which  is  between  the 
original-number-on-test  and  the  number-of -failures. 
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horizontal  and  vertical  lines;  they  will  be 
parallel  to,  and  KS,  from,  the  sample  Cdf. 
Then  “1  — s-confidence”  is  the  fraction  of 
times  you-do-this-procedure  that  the  true 
Cfcifwill  partly  lie  outside  the  2-sided  5-con- 
fidence bounds.  In  general,  you  will  be  dis- 
heartened at  how  little  you  know  about  the 
true  Cdf. 

Drawing  the  data-lines:  draw  the  two  par- 
allel lines,  farthest  apart,  that  fit  reasonably 
well  within  the  s-confidence  bounds;  use 
both  to  estimate  bounds  on  the  “intercept” 
parameter  of  the  straight  line  (e.g.,  the  mean 
for  the  s-normal  distribution).  Draw  the  two 
intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  well  within  the 
s-confidence  bounds;  use  both  to  estimate 
bounds  on  the  “slope”  parameter  of  the 
straight  line  (e.g.,  the  standard  deviation  for 
a s-normal  distribution). 

Table  2- 1(A)  also  can  be  used  the  other 
way:  if  a true  Cdf  is  drawn,  then  all  sample 
points  will  lie  within  ±KS„  from  it,  with  the 
stated  s-confidence.  Several  examples  are 
given  in  the  paragraphs  that  follow  for  using 
this  method  of  K-S  Bounds.  The  K-S  stands 
for  Kolmogorov-Smirnov  (two  Russians  who 
developed  much  of  the  theory). 

2-2. 1.2  Plotting  (Beta  Bounds) 

If  a sample  of  N is  drawn  from  the  uni- 
form distribution  (representing  a Cdf),  and 
then  the  results  are  put  in  order  from  lowest 
to  highest,  the  pdf  and  Cdfof  the  k-th 
order-statistic  are 

Cdf{p^,s]= 

j=k  ' 

(2-3a) 

pdf{pk,s]  = ~Pk,N^^  * 

(2-3b) 

This  is  a beta  distribution  and  its  properties 


are  well  known  (see  Part  Six,  Mathematical 
Appendix  and  Glossary).  The  mean,  mode, 
and  median  of  are 

E{/>fe.iv}  = fe/(iV+ 1)  (2-4a) 

mode{^fe,jv}  = (&  — 1)/(N  - 1)  (2-4b) 

median - 0.3)/(.N' -r  0.4) 

(2-4c) 

The  mean  value,  Eq.  2-4a,  is  used  often  and 
reasonably  as  the  plotting  position- simply 
beeause  it  is  so  easy  to  calculate;  but  it, 
alone,  gives  no  idea  of  the  uncertainty  in- 
volved due  to  the  random  nature  of  the  data. 
The  median,  Eq.  2-4c  is  also  reasonable  to 
use,  but  is  less  popular  because  of  its  greater 
complexity.  The  expression  (k  — 0.5)/N  is 
fairly  popular  as  a plotting  position,  and  is 
as  reasonable  as  any  single  one,  but  it  has 
no  simple  property  to  give  it  a name. 

Table  2- 1(B)  lists  3 plotting  positions  for 
eaeh  point;  so  the  uncertainty  is  plainly 
shown  on  the  graph.  These  are  the  points 
for  which  the  Cdf  in  Eq.  2-3a  is  5%,  50%, 
95%;i.e.,  only  1 point  in  10  would  be  out- 
side that  range.  Later  paragraphs  in  this 
chapter  illustrate  the  use  of  these  plotting 
positions . 

This  method  of  plotting  is  called  “Beta 
Bounds”,  just  to  have  a short  name  for  it. 

2-2.2  PLOTTING  POSITIONS  (CUMULA- 
TIVE HAZARD) 

When  some  of  the  items  are  removed  from 
test  before  they  fail,  and  the  test  is  continued 
for  other  failures,  the  plotting  positions  for 
the  Cdfare  very  difficult  to  calculate.  Ref 
23  shows  how  data  can  be  simply  plotted  in 
this  situation.  The  errors  incurred  in  using 
this  method  are  probably  small  compared  to 
the  uncertainties  involved.  Unfortunately,  it 
is  not  feasible  to  provide  a rigorous  measure 
of  that  uncertainty. 
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TABLE  2-1  (B) 

BETA  BOUNDS  METHOD:  PERCENTAGE  PLOTTING  POINTS  OF  THE 
k-th  ORDERED-FAILURE,  OUT  OF  A TOTAL  SAMPLE  OF  N. 


Jtx* 

3 

4 

5 

6 

2_ 

£ 

i. 

10 

±L 

1 

1.7/21/63 

1,2/16/53 

1.0/13/45 

0.85/11/39 

0.74/9.4/35 

0.65/8.3/31 

0.57/7.4/28 

0,51/6.7/26 

0.47/6,1/24 

2 

14/50/86 

9.8/39/75 

7.6/31/66 

6.3/27/58 

5.3/23/52 

4.7/20/47 

4.1/18/43 

3.7/16/39 

3.3/15/36 

3 

19/50/8 1 

15/42/73 

13/36/66 

1 1/32/60 

9.8/29/55 

8.7/26/51 

8.0/24/47 

4 

23/50/77 

19/44/71 

17/39/66 

15/36/6 1 

14/32/56 

5 

25/50/75 

22/45/70 

20/4 1/65 

6 

27/50/73 

12 

13 

14 

15 

16 

17 

18 

19 

20 

1 

0.43/5.6/22 

0.40/5.2/21 

0.37/4.8/19 

0.34/4.5/ 18 

0.32/4.2/17 

0.30/4.0/16 

0.29/3.8/16 

0.28/3.6/15 

0.26/3.4/14 

2 

3.1/14/34 

2.8/13/32 

2.6/12/30 

2.5/11/28 

2.3/10/26 

2.2/9.8/25 

2.1/9.2/24 

1.9/8.7/23 

1.8/8.3/22 

3 

7.2/22/44 

6.7/20/41 

6.1/19/39 

5.7/18/36 

5,4/16/34 

5.0/16/33 

4.8/15/31 

4.5/14/30 

4.3/13/29 

4 

12/30/53 

1 1/28/49 

10/26/47 

9.7/24/44 

9.1/23/42 

85/21/40 

8,0/20/38 

7,6/19/36 

7.3/18/35 

5 

18/38/61 

17/35/57 

15/33/54 

14/31/51 

13/29/48 

12/27/46 

12/26/44 

11/24/42 

11/23/40 

6 

25/46/68 

23/43/65 

21/40/61 

19/37/58 

18/35/55 

1 7/33/52 

16/31/50 

15/29/48 

14/28/46 

7 

29/50/7 1 

27/47/67 

25/44/64 

23/41/61 

21/39/58 

20/36/55 

19/35/53 

18/33/51 

8 

30/50/70 

28/47/67 

26/44/65 

24/42/6 1 

23/40/58 

22/38/56 

9 

31/50/69 

29/47/66 

27/45/63 

26/43/60 

10 

32/50/68 

30/48/65 

22 

24 

26 

28 

30 

35 

40 

45 

SO 

1 

0.23/3.1/13 

0.21/2.9/12 

0.20/2.6/11 

0.18/2.5/10 

0.17/2.3/9.5 

0.15/2.0/8.2 

0.13/1.7/7.2 

0.1  1/1. 5/6.4 

0.10/1.4/5.8 

2 

1,6/7.5/20 

1.5/6.9/18 

1.4/6.4/17 

1.3/5.9/16 

1.2/5.5/15 

1.0/4.8/13 

0.90/4.2/11 

0,79/3.7/10 

0.7  1/3.3/9.1 

3 

3,8/12/26 

3.5/11/24 

3.2/10/22 

3.0/9.4/21 

2.8/8.8/20 

2.4/7.6/17 

2.1/6.6/15 

1.8/5.9/13 

1,7/5.3/12 

4 

6.5/16/32 

5,9/15/29 

5.4/14/27 

5.0/13/25 

4.7/12/24 

4.0/10/21  . 

3.5/9.1/18 

3.1/8.1/16 

2.8/7.3/15 

5 

9.4/21/37 

8.6/19/34 

7.9/18/32 

7.3/16/30 

6.8/15/28 

5.8/13/24 

5.1/12/21 

4.5/10/19 

4.0/9.3/17 

6 

13/25/42 

1 1/23/39 

11/22/36 

9.8/20/34 

9.1/19/32 

7.7/16/28 

6.7/14/25 

6.0/13/22 

5.4/11/20 

7 

16/30/47 

15/27/43 

13/25/40 

12/22/36 

9.8/19/31 

8.5/17/27 

7.5/15/25 

6.8/13/22 

8 

20/34/52 

18/32/48 

16/29/45 

15/27/42 

14/25/39 

12/22/34 

10/19/30 

9.2/17/27 

8,3/15/25 

9 

23/39/56 

21/36/52 

19/33/49 

18/31/46 

17/29/43 

14/25/37 

12/21/33 

11/19/30 

9.7/17/27 

10 

27/43/60 

25/40/56 

23/37/53 

21/34/49 

19/32/47 

16/27/41 

14/24/36 

13/2 1/32 

11/19/29 

11 

31/48/65 

28/44/60 

26/41/56 

24/38/53 

22/35/50 

19/30/44 

16/26/39 

14/24/35 

13/2  1/32 

12 

32/48/64 

29/44/60 

27/41/57 

25/38/53 

22/34/47 

18/29/41 

16/26/37 

14/23/34 
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TABLE  2-1  (B).  (cont’d) 


22 

24 

30 

25 

40 

50 

13 

33/48/64 

30/45/60 

28/42/57 

24/36/50 

20/31/44 

18/28/40 

16/25/36 

14 

33/48/63 

31/45/60 

26/39/52 

22/34/47 

20/30/42 

1 8/27/38 

15 

34/48/63 

29/42/55 

25/36/49 

22/32/44 

19/29/40 

16 

31/44/58 

27/39/52 

24/35/47 

21/31/42 

17 

34/47/6  1 

29/4 1/54 

26/37/49 

23/33/44 

18 

36/50/64 

31/44/57 

28/39/5 1 

25/35/47 

19 

34/46/59 

30/4  1/53 

26/37/49 

20 

36/49/62 

32/43/56 

28/39/5 1 

21 

34/46/58 

30/4 1/53 

22 

36/48/60 

32/43/55 

23 

38/50/62 

34/45/57 

24 

36/47/59 

25 

38/49/60 

The  body  of  the  table  lists  for  each  (/r,  /V)  the  5%/50%/95%  points  for  plotting  purposes.  To  obtain  the  5%/50%/95%plotting  points  for  (/V  + 1 —k,  N)  reverse  the  order  from  the  {k,  N) 
and  subtract  each  from  100%.  For  example,  for  (k,  Ni  = (2,  5)  the  percentage  plotting  points  are  7.6/31/66.  For  (/V  + 1 — K /Vl  = (4,51,  the  percentage  plotting  points  are 
(100  - 66)/(100  - 31)/(100  - 7.6)  = 34/69/92.4. 

Points  through  n = 20  ate  adapted  from  Ref.  4 
Points  above  n = 20  ate  adapted  from  Ref.  26. 

All  ate  roundedoff  to  2 singificant  figures. 

Interpolation  for  values  of  N not  shown:  For  k small,  interpolate  (roughly)  on  a horizontal  line.  For  values  of  k near  {N/2),  interpolate  on  a diagonal  ik/N  «=  constant);  in  that  region 
they  ate  roughly  of  the  form:  median  plotting-point  ± deviation.  The  deviation  is  easily  calculated  from  the  tabulated  values,  and  the  median  plotting-point  Is  easily  estimated  from  Eq, 
2-5. 
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The  cumulative  hazard  H is  related  to  the 
5/ by  the  equations 

Sf{x}  = exp  [-  Hbc)  ] (2-5a) 

H(x)  = - In  [S/W]  = - In  [1  - Cdf{x}] 

(2-5b) 

So  a plotting  scale  can  be  calculated  for  any 
probability  paper  by  using  Eq.  2-5b.  Special 
paper  can  be  drawn  for  more  convenient 
hazard  plotting  and  is  mentioned  in  Ref  23; 
but  it  is  not  at  all  necessary. 

Even  if  no  rigorous  method  is  available  for 
estimating  the  uncertainty,  it  is  desirable  to 
get  some  idea  about  it.  The  procedure  that 
follows  provides  grossly-approximate  K-S 
bounds  (par.  2-2. 1.1).  It  has  the  advantage 


that  the  same  general  plotting  technique  is 
used  as  for  the  K-S  Bounds  method.  These 
instructions  are  also  given  on  the  Instructions 
side  of  the  Practical  Probability  Paper. 

Plot  failure  r at  the  two  points 

Fh!  ==  1 — exp  (—  Hf)  (2-6a) 

Flo  = 1 - exp  (-  Hr-i)  (2-6b) 

to  convert  the  sample  cumulative  hazard 
to  the  Cdf.  Connect  the  points  with  hori- 
zontal and  vertical  lines;  this  is  the  sample 
Cdf.  Calculate  and  plot  the  K-S  bounds  as 
in  par.  2-2. 1.1  and  Eq.  2-2.  The  s-confidence 
bounds  will  not  be  exact  at  all. 

Table  2-2  shows  some  failure  data  on  field 
windings  of  electric  generators.  The  hazard 


TABLE  2-2 

CUMULATIVE-HAZARD  CALCULATIONS  FOR  FIELD  WINDINGS 
OF  SOME  ELECTRIC  GENERATORS 

The  table  lists  time-to-failure  (months)  for  failed  units  andtime-to-end-of-test 
(months)  for  unfailed  units.  All  times  are  listed  in  order  of  increasing  time. 


Rank 

Ordered  event 

Reverse 

Hazard 

Cumulative 

r 

time 

rank 

increment  AW 

hazard  W^ 

1 

31.7  F 

16 

0.0625 

0.0625 

2 

39.2  F 

15 

0.0667 

0,1292 

3 

57.5  F 

14 

0.071  4 

0.201 

4 

65.0 

13 

5 

65.8  F 

12 

0.0833 

0.284 

6 

70.0  F 

11 

0.0909 

0.375 

7 

75.0 

10 

8 

75.0 

9 

g 

87.5 

8 

10 

88.3 

7 

11 

94.2 

6 

12 

101.7 

5 

13 

105.8  F 

4 

0.250 

0.625 

14 

109,2 

3 

15 

110.0  F 

2 

0.500 

1.12 

16 

130.0 

1 

F indicates  failure.  Other  times  are  censorings  (removed  from  test  before  failure,  for  a 
reason  not  connected  with  the  state  of  the  item). 
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increment  is  the  reciprocal  of  the  reverse 
rarik.  for  the  failed  units;  the  hazard  does 
not  inerement  for  nonfailed  units.  The 
times-to-failure  are  plotted  on  the  time  seale 
of  the  appropriate  paper,  and  the  eumulative 
hazard  is  plotted  on  the  eumulative-hazard 
or  on  the  Cdf  scale.  This  procedure  is  illus- 
trated in  some  of  the  examples. 

2-2.3  s-NORMAL  DISTRIBUTION 

The  basis  for  the  graph  paper  is  that  the 
equation 

F = Cdf{x}  = gauf  ) (2_7) 

ean  be  transformed  to 

gau/“^(F)  = ^ ^ ^ (2-8a) 

or 

X = <T  • g-au/~^(F)  + M . (2-8b) 

The  C<i/ scale  is  actually  the  gauf  scale. 

The  heavy  dashed  line  on  ^-Normal  Practieal 
Probability  Paper  is  drawn  as 

F = 50%,  X = . (2-9a) 

The  S-scale  is  linear  in  gauf”' . For  example, 
the  S = ± 1 points  are  at 

F - 84.13%,  X = + u,  for  S = + 1 

(2-9b) 

F = 15. 87%,  x = n - a,  for  S = - 1 . 

(2-9c) 

Several  examples  illustrating  methods  of 
plotting  the  data  are  presented— Example 
Nos.  1(A)  through  1(F).  The  data  are  pre- 
pared 3 ways: 

1.  For  K-S  Bounds  plotting 


2.  For  Beta  Bounds  plotting 

3.  To  show  the  Hazard  plotting  teehnique. 

Since  the  data  are  not  eensored  (they  are 
complete),  the  Hazard  plotting  is  not  nee- 
essary.  But  the  comparison  of  plotting  posi- 
tions is  useful.  Col.  8 (plotting  position  for 
Hazard  plotting)  is  very  close  to  eol.  3 
(plotting  position  for  K-S  Bounds  method). 
Cols.  5-8  merely  illustrate  the  ealeulations 
for  the  Hazard  plotting  and  are  not  used 
elsewhere. 

First  the  K-S  Bounds  Method  is  shown. 
s-Normal  Practical  Probability  Paper  is  used. 
Cols.  2-3  from  Table  2-3  (Data  Set  A)  are 
used;  see  Example  No.  1(A). 

It  is  not  feasible  to  put  quantitative  s-con- 
fidence  levels  on  the  interval  estimates  for  ju 
and  a;  analytic  methods  are  necessary  for 
that.  Nevertheless,  these  intervals  are  a good 
engineering  measure  of  the  uncertainties  in- 
volved. Some  of  the  important  conclusions 
from  this  graphical  exercise  are: 

1.  Not  very  much  is  known  about  the  dis- 
tribution of  failure  times  of  these  fuel  pumps. 
For  example,  if  one  were  interested  in  the 
time  at  which  2%of  the  fuel  pumps  will 
have  failed,  it  is  tempting  to  use  line  #5,  and 
guess  about  240  hr.  But  that  point  really  is 
only  known  to  within  the  range  0 to  1200 
hr. 

2.  Whether  the  data  ean  reasonably  be 
represented  (summarized)  by  an  s-Normal 
distribution  is  almost  irrelevant. 

3.  5%  of  the  time  we  go  through  this 
proeedure  (the  s-eonfidence  was  95%),  the 
true  Cfcifwill  not  lie  wholly  within  that  very 
wide  envelope. 

4.  The  fuel  pump  may  have  roughly  10% 
defeetives  (line  #4),  i.e.,  lives  so  short  as  to 
be  of  eritieal  concern.  Perhaps  this  is  reason 
enough  to  ground  the  aireraft  until  further 
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TABLE  2-3 

DATA  SET  A (Ref.  4) 

Ordered  failure  times  (in  flight  hours)  for  a pump  in  the  fuel-delivery  system  of  an  aerial  fire-support  helicopter. 

N = 20.  The  entire  set  of  20  was  failed;  so  there  is  no  censoring.  Columns  1 and  2 present  the  original  data.  Column 
3 shows  the  calculation  for  plotting  the  sample  Cdf  in  the  K-S  Bounds  method.  Column  4 shows  the  3 plotting  posi- 
tions for  the  Beta  Bounds  method.  The  remainingcolumns  are  included  merely  to  show  how  the  Hazard  plotting 
compares  with  Cdf  plotting  in  the  Ccse  where  there  is  no  censomg  and  the  two  methods  can  be  compared  directly. 


Rank 

Failure 
time,  hr 

r/N,  % 

Cdf  plot- 
ting posi- 
tion, % 
(Table  2-1  (B» 

Reverse 

rank 

Hazard 
incre- 
ment AW*’ 

Cumula- 
tive haz- 
ard A/,.*’ '31 

Cdf  = 

1 - exp  l-W,), 
%<^> 

1 

175 

5 

0.26/3.4/14 

20 

0.050 

0.050 

4.9 

2 

695 

10 

1.8/8.3/22 

19 

0.053 

0.103 

9.8 

3 

872 

15 

4.3/13/29 

18 

0.056 

0.1  58 

14.6 

4 

1250 

20 

7,3/18/35 

17 

0.059 

0.217 

19.5 

5 

1291 

25 

1 1/23/40 

16 

0.063 

0.280 

24.4 

6 

1402 

30 

14/28/46 

15 

0.067 

0.346 

29.3 

7 

1404 

35 

18/33/5 1 

14 

0.071 

0.418 

■34.1 

8 

1713 

40 

22/38/56 

13 

0.077 

0.495 

39.0 

g 

1741 

45 

26/43/60 

12 

0.083 

0.578 

43.9 

10 

1893 

50 

30/48/65 

11 

0.091 

0.669 

48.8 

11 

2025 

55 

35/52/70 

10 

0.100 

0.769 

53.6 

12 

21 15 

60 

40/57/74 

9 

0.111 

0.880 

58.5 

13 

21 72 

65 

44/62/78 

8 

0.1  25 

1.005 

63.4 

14 

2418 

70 

49/67/82 

7 

0.143 

1.148 

68.3 

15 

2583 

75 

54/72/86 

6 

0.1  67 

1.314 

73.1 

16 

2725 

80 

60/77/89 

5 

0.200 

1.514 

78.0 

17 

2844 

85 

65/82/92.7 

4 

0.250 

1.764 

82.9 

18 

2890 

90 

71/87/95.7 

3 

0.333 

2.098 

87.7 

19 

3268 

95 

78/91.7/98.2 

2 

0.500 

2.598 

92.6 

20 

3538 

100 

86/96.6/99.74 

1 

1.000 

3.598 

97.3 

1 ) Calculations  made  to  8 significant  figures;  only  3 decimal  places  recorded. 

2)  AH  = 1 /(reverse  rank) 

3)  = SAW,- 

4)  This  Is  the  Cdf  plotting  position  that  corresponds  to  the  cumulative  hazard;  this  technique  is  used  when  the  Hazard  scale  is  not 
shown  on  the  graph  paper. 


investigation  and/or  corrective  action  shows 
it  to  be  safe.  The  long-lived  units  might  be 
studied  to  find  out  why  they  were  so  good. 

5.  If  the  K-S  Bounds  method  had  not 
been  used,  the  uncertainty  would  not  have 
been  realized.  An  engineer  could  easily  have 
presumed  that  line  #5  was  the  whole  story 
and  thus  misled  himself  and  others  about 


the  results. 

The  same  data  set  will  now  be  plotted  by 
the  Beta  Bounds  method.  Cols.  2 and  4 
from  Table  2-3  (Data  Set  A)  are  used;  see 
Example  No.  1 (B). 

Two  more  data  sets  (B  in  Table  2-4,  and 
C in  Table  2-5)  are  plotted  to  help  illustrate 
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Example  No.  1(A) 

Data  Set  A,  K—S  Bounds  Method  (Table2— 3,  Fig,  2— 1(A)) 


Procedure 


Example 


1.  Choose  a s- confidence  level. 
Use  a number  near  1 - 1/N. 
Find  JCS,  from  Table  2— 1(A). 

2.  Plot  the  data  from  Cols.  2—3 
using  the  instructions  on  the 
Practical  Probability  Paper. 

3.  Find  the  lower  and  upper 
estimates  of  , Ml  and  Mp- 


4.  Find  the  lower  and  upper 
estimates  of  a,  Cl  and 


5.  Draw  line  #5  for  the  point 
estimates  of  M and  a,  /x  and 

A 

cr. 


6.  Summarize  the  results. 


1.  N = 20 

1 — 1/N  = 95%.  Use  95%s- confidence. 

KS„  = 0.29. 

2.  Prepare  Col.  3 cf  Table  2-3. 

Plot  on  Fig.  2— 1(A). 

3.  Lines  #1  and  "2  are  the  two 

parallel  lines  for  m ■ #1  intersects  the  heavy 
dashed  line  (50%line)  at  Ml  “ 1400  hr,  #2 
at  Ml/  = 2440  hr. 

4.  Lines  #3  and  #4  are  the  two  intersecting 
lines  for  u For  line  #3,  choose  S2  = + l, 

Sj  = 0;  then  ol  = 2250  hr  — 1960  hr  = 290  hr. 
For  line  #4,  choose  S2  = + 0.5,  Si  = — 0.5; 
then  = 3360  hr-  400  hr  = 2960  hr. 

5.  Lines  #3  and  #4  were  drawn  sothat  their 
intersection  would  be  at  the  50%line  and 
midway  between  lines  #1  and  #2.  This  was 
for  an  unnecessary  esthetic  sense,  sothat 
line  ^15  could  be  drawn  through  the  intersec- 
tion of  lines  #3  and  #4  and  be  parallel  to  and 
midway  between  lines  #1  and  #2.  p,  = 1920 
hr,  a = (2700  hr  - 1080  hr)/[+  1 - (-  1)] 

= 810  hr. 

6.  (1^  = 2440  hr,  (Tjj  = 2960  hr 
M = 1920  hr,  = 810  hr 
Ml  = 1400  hr,  Ol  = 290  hr. 
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Figure  2- 1 (A).  Data  Set  A,  s-Normal  Scale.  K-S  Bounds  Method 


Instructionsfor  Use 
s-Normal  (Gaussian)  Distribution 


Practical  Probability  Paper 
Evans  Associates 


• Piotting  data:  Piot  faiiure  r at  the  two  points:  =r/n  and  = 

{r  -^)/n.  Connect  the  points  with  horizontai  and  vertical  lines;  this  is 
the  sample  Cdf. 

• Plotting  cumuiative-hazard  data:  Plot  failure  r at  the  two  points  Fj^l 
= 1 — exp(-wp  and  Fj^^^  = 1 — exp(— to  convert  the  sample 
cumulative-hazard  to  the  Cdf.  Connect  the  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  s-confidence  bounds  will 
not  be  exact. 

• 2-sided  sconfidence  bounds  on  the  actual  Cdf:  Choose  the 

s-confidence  level,  near  1-(1/n)  is  reasonable;  then  find  KS^  from  the 
body  of  the  Table  (e.g.,  r)=10,  s-conf=95%,  KS^=0.41).  The  upper 
bound  is  plotted  at  lower  bound  is  plotted 

at  Flo  -KS^,  For  each  bound,  connect  the  points  with 

horizontal  and  vertical  lines;  they  will  be  parallel  to,  and  KS^  from,  the 
sample  Cdf.  Then  1 -s-conf  is  the  fraction  of  times  youdo-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
s-confidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf. 

• Drawing  data-iines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonabiy  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  p.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonabiy  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  cr, 

• To  estimate  p:  p is  the  vaiue  of  x at  which  a data-line  intersects  the 
heavy  dashed  iine  (F^  = 50.0%). 

• To  estimate  o:  Take  two  vaiues  of  S.  Si  and  $2;  then  find  the  two  x 
vaiues,  X,  and  X2,  which  correspond  to  Si  and  S2,  via  a data-line.  o = 
Ix2  — Xf  1/IS2  “ S)  I.  if  IS2  — Si  I = 1,  then  cr  = Ix2  — Xi  I. 


Tabie  of  K-S  Bounds 


n KS^  (sconfidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

A1 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

,31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

.21 

.24 

.25 

n 

1.22 

1.36 

1.52 

1.63 

/ttft 

x/TtTT 

/TTFT 

v/TtTT 

(formula  is  o.k.  for  n>6) 

For  censored  samples,  use  an  n which  is  between  the 
original-number-on-test  and  the  number-of-faiiures. 


s-Normai  (Gaussian)  Distribution 

F(x)  = gauf  gauf  (z)  is  the  standard  s-normai 

Cdf 

F Cumuiative  distribution  function  (Cdf) 

H iocation  parameter  (same  units  as  x),  aiso  the 
median  and  mean  (average) 
o scaie  parameter  (same  units  as  x),  aiso  the  standard 
deviation 
n sampie  size 

r faiiure  number;/- = 1, 2,  ...  ,n 
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Example  No.  1(B) 


Data  Set  A,  Beta  Bounds  Method  (Table  2— 3,  Fig,  2-l(B)) 


Procedure 


Example. 


1.  Plot  the  59(/507o/95%  points  for  each  failure 
time. 


2.  Sketch  a curve  through  the  5%and  through 
the  95%plotting  points. 

3.  Draw  the  "best"  straight  line  through  the 
50% plotting  points.  It  will  more  or  less 
bisect  the  region  between  the  5%and  95% 
plotting  point  curves. 

4.  Draw  2 more  straight  lines  through  a cen- 
tral 50%population  point:  one  with  the  max- 
imum feasible  slope  and  the  other  with  the 
minimum  feasible  slope. 

5.  Estimate  My,  M,  Ml  from  the  curves  ^1, 

#3,  #5,  respectively.  They  are  all  the  in- 
tersection with  the  heavy  dashed  line.  They 
are  the  high  limit,  point  estimate,  and  low 
limit,  respectively. 

6.  A separate  scale  is  rarely  given  for  the 
scale  parameter  a.  It  is  easily  estimated 
from  the  fact  that  the  16%and  84%popula- 
tion  points  are  each  la  away  from  the  50% 
population  point.  The  S-scale  could  have 
been  used,  along  with  the  instructions  on  the 
back  of  Fig.  2— 1(A).  {a■^,  a,  and  are 
read  from  curves  2,  3,  and  4 of  Fig.  2— 1(B), 
respectively.  ) 


1.  Prepare  Table  2—3  col.  3 
from  Table  2— 1(B).  Plot  on 
Fig.  2-KB). 

2.  See  curves  land  5 on  Fig. 
2-KB). 

3.  Draw  line  "3. 


4.  Draw  lines  #2  and  #4. 


5.  My  = 2460  hr  (high  limit) 

M = 1950  hr  (point  estimate) 
Ml  = 1460  hr  (low  limit). 

6.  ap  = (3400  - 500)/2  = 1450  hr 
CT  = (2980  - 1000) /2  = 990  hr 
(Ti  = (2600  - 1300)/2  = 650  hr. 


It  is  not  feasibleto  put  quantitative  s-confidence  levels  on  the  upper  and  lower 
limits  for  m or  a.  The  conclusions  to  be  drawn  are  essentially  the  same  as  from 
Fig.  2-1  (A). 
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Figure  2-1  (Bj.  Data  Set  A,  s-Norma!  Scale.  Beta  Bounds  Method 
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TABLE  2-4 
DATA  SET  B 


The  same  data  set  is  plotted  by  the  Beta 
Bounds  method  for  eomparison  with  the 
K-S  Bounds  method;  see  Example  No.  1 (E). 


Ordered  failure  times  (simulated)  of  ball  bearings. 
Test  stopped  at  the  5th  failure,  5 unfailed.  N = 10. 


Rank 

Failure 
time,  hr 

r/N.% 

Cdf  Plot- 
ting posi- 
tion, % 
(Table  2-1) 

1 

497 

10 

0.51/6.7/26 

2 

546 

20 

3.7/16/39 

3 

557 

30 

8.7/26/51 

4 

673 

40 

15/36/61 

5 

789 

50 

22/45/70 

TABLE  2-5 
DATA  SET  C 

Ordered  failure  times  (simulated)  of  ball  bearings. 
Entire  set  of  10  was  failed.  (This  is  the  same  set  as 
B,  except  the  test  was  continued  until  all  had  failed.) 
A/=  10. 


Rank 

Failure 
time,  hr 

r/N,% 

Cdf  Plot- 
ting posi- 
tion, % 
(Table  2-1) 

1 

497 

10 

0.51/6.7/26 

2 

546 

20 

3.7/16/39 

3 

557 

30 

8.7/26/51 

4 

673 

40 

15/36/61 

5 

789 

50 

22/45/70 

6 

805 

60 

30/55/78 

7 

1150 

70 

39/64/85 

8 

1450 

80 

49/74/91.3 

9 

1690 

90 

61/84/96.3 

10 

3090 

100 

74/93.3/99.49 

1 — 1//V  = 90%;  use90%s-confidence.  KS„  = 0.37 


the  utility  of  the  graph  paper.  Data  Set  B is 
censored  as  shown  in  Table  2-4;  the  4 col- 
umns have  been  prepared  as  for  Data  Set  A, 
and  the  points  plotted;  see  Example  Nos.  1(C) 
and  1(D). 


2-2.4  WEIBULL  DISTRIBUTION 

The  form  of  the  Weibull  distribution  being 
used  is 

R = Sf{t ; a,  ^}  = ejq)  [-  {t/af]  (2-10) 

Eq.  2-5b  shows  that  the  cumulative  hazard 
for  the  Weibull  is 

H{t)  = (2-11) 

The  Weibull  paper  is  derived  by  taking  log 
(In)  of  Eq.  2-10. 

In  i?  = - (2-12a) 

log  (—  In  R)  = ^ log  t — ^ log  Q!  (2-12b) 

So  log  t plotted  against  log  (-In  R)  is  a 
straight  line.  Most  Weibull  papers  use 
In  (-ln(R)J  for  Eq.  2-12b  and  so  have  to 
use  awkward  methods  to  find  (3. 

The  proeedure  for  trying  the  Weibull 
distribution  is  quite  similar  to  that  for  the 
s-normal,  except  that  Weibull  probability 
paper  is  used.  This  is  shown  in  detail  for 
Data  Set  D later  in  this  paragraph. 

Data  Set  A from  Table  2-3  is  plotted  in 
Fig.  2-4;  the  K-S  Bounds  method  is  used, 
with  95%s-confidence  bounds  {N  = 20, 

KS,  = 0.29).  Following  the  instructions  on 
the  reverse  side  of  Fig.  2-4,  one  obtains 

= 1700  hr,  G!  = 2200  hr, 

= 2900  hr 


^r  = 0.9,  3 = 2.1,  = 6 . 

This  sample  could  easily  have  come  from  a 
Weibull  distribution.  If  the  true  distribution 
[text continues  on  page  2-27] 
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Example  No.  1(C) 

This  example  uses  Data  Set  B,  see  Example  Nos.  1(C)  and  1(D),  Table  2— 4 
Data  Sets,  K—S  Bounds  Method  (Table2— 4.  Fig,  2—2) 


Procedure 

1.  Choose  a s-confidence  level.  Use 
a number  near  1 - 1/N,  Find  KS, 
from  Table  2— 1(A)  or  the  table  on 
reverse  side  cf  Fig.  2—2. 

2.  Plot  the  data  from  Cols.  2-3  us- 
ing the  instructions  on  the  Practi- 
cal Probability  Paper. 

3.  Find  the  lower  and  upper  esti- 
mates of  F , and  My. 


4.  Find  the  lower  and  upper  esti- 
mates of  cr,  o-y  and  o-y.  Use  the 
S scale. 


5.  Draw  line  #5  for  the  point  esti- 
mates of  M and  cr,  A and  a. 


Example 

1.  A = 10 

1 - 1/N  = 90%.  Use  90%  s-confidence. 
KS,  =0.7. 

2.  Prepare  Col.  3 cf  Table  2—4. 

Plot  on  Fig.  2-2. 

3.  Use  lines  #1  and  #2. 

M Mj,  = 600  hr 

My  = 1000  hr. 

4.  Use  lines  #3  and  #4. 

Oi  = 100  hr 

(Ty  = 800  hr. 

5.  M = 800  hr 

CT  = 260  hr. 


It  is  difficult  to  tell  much  from  the  data.  The  scatter  and  uncertainty  are  brought 
forcibly  to  the  engineer's  attention.  The  10%failure  point  appears  to  be  somewhere 
between  0 and  650  hr.  Since  the  data  tell  so  little,  they  are  not  plotted  by  the  Beta 
Bounds  method. 
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Figure  2-2.  Data  Set  B,  s-Normal  Scale.  K-S  Bounds  Method 
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Instructions  for  Use 


Practical  Probability  Paper 
Evans  Associates 


s-Normal  (Gaussian)  Distribution 


• Plotting  data:  Plot  failure  r at  the  two  points:  F|^j  =r!n  and  = 
(r  -1)//7.  Connect  the  points  with  horizontal  and  vertical  lines;  this  is 
the  sample  Cdf. 

• Plotting  cumulative-hazard  data:  Plot  failure  r at  the  two  points  F|^l 
= 1 — exp(— and  Fj_o  “ 1 ~exp(— to  convert  the  sample 
cumulative-hazard  to  the  Cdf.  Connect  the  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  s-confidence  boundswill 
not  be  exact. 

• 2-sided  s-confidence  bounds  on  the  actual  Cdf:  Choose  the 

s-confidence  level,  near  1-(1/n)  is  reasonable;  then  find  KS^  from  the 
body  of  the  Table  (e.g.,  n=10,  s-conf=95%,  KS^=0.41).  The  upper 
bound  is  plotted  at  lower  bound  is  plotted 

at  For  each  bound,  connect  the  points  with 

horizontal  and  vertical  lines;  they  will  be  parallelto,  and  KS^  from,  the 
sample  Cdf.  Then  1— s-conf  is  the  fraction  of  times  youdo-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
s-confidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf, 

• Drawing  data-lines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonably  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  p.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  o. 

• To  estimate  p:  p is  the  value  of  x at  which  a data-line  intersects  the 
heavy  dashed  line  (F^  = 50.0%). 

• To  estimate  a:  Take  two  values  of  S.  S.|  and  S2;  then  find  the  two  x 
values,  svid  xj,  which  correspond  to  S.|  and  Sj,  via  a data-line,  a = 
Ix2  — x.|  I/IS2  — S.|  I.  If  B2  — l=  1,  then  a=  Ix2  — x^  I. 


Table  of  K-S  Bounds 


n KS^  (sconfidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

.47 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

.21 

.24 

.25 

n 

1 77 

1.52 

1.63 

/oTT 

7/J+l 

v/TtTT 

•J  n+\ 

(formula  is  o.k.  for  n>6) 

For  censored  samples,  use  an  n which  is  between  the 
original-number-on-test  and  the  number-of-failures. 


s-Normal  (Gaussian)  Distribution 

F(x)  = gauf  gauf  (z)  is  the  standard  s-normal 

Cdf 

F Cumulative  distribution  function  (Cdf) 
p location  parameter  (same  units  as  x),  also  the 
median  and  mean  (average) 
a scale  parameter  (same  units  as  x),  also  the  standard 
deviation 
n sample  size 

r failure  number, T = 1,  2,  ...  ,n 
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Example  No.  1(D) 

This  example  uses  Data  Set  C,  Table  2—5. 

Data  Set  C.  JC-S  Bounds  Method  (Table 2— 5.  Fig,  2-3{A)) 

Procedure  Example 

1.  Choose  a s-confidence  level.  Use  1. 
a number  near  1 - l/N,  Find  KS„ 
from  Table  2— 1(A)  or  the  table  on 
reverse  side  of  Fig.  2-3(A). 

2.  Plot  the  data  from  Cols.  2—3  us-  2. 
ing  the  instructions  on  the  Practi- 
cal Probability  Paper. 

3.  Find  the  lower  and  upper  esti-  3. 

mates  of  M , Mx.  gy. 

4.  Find  the  lower  and  upper  esti-  4. 

mates  of  cr,  CTx,  ^nd  ctjj.  Use  the 
S-scale. 

5.  Find  the  point  estimates  cf  M and  5. 
and  <T,  M and  a. 

Some  of  the  important  conclusions  from  this  graphical  exercise  are: 

1.  Not  much  is  known  about  the  shape  of  the  distribution;  it  could  easily  be 

s-Normal. 

2.  The  time  for  10%  failures  is  not  known  well;  it  is  probably  between  0 and 

800  hr. 

3.  Only  ballpark  ideas  about  the  distribution  are  known. 

4.  The  estimates  of  the  distribution  are  quite  different  than  from  the  censored 

version  of  Data  Set  B. 


N = 10. 

1 — 1/N  = 90%.  Use  90% s-confidence. 
KS„  = 0.37. 

Prepare  Col.  3 of  Table  2—5. 

Plot  on  Fig.  2-3 (A). 

fj.j^  - 620  hr 
= 1400  hr. 

Oi  = 220  h r 
CTy  = 1900  hr. 

M = 1000  hr 
cr  = 730  hr. 
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Example  No,  IfE) 

This  example  uses  Data  Set  C,  Table  2—5. 

Data  Set  C,  Beta  Bounds  Method  (Table 2-5,  Fig,  2-3(B)) 

Procedure  Example 

1.  Plot  the  5%/50%/95%  plotting  points.  1.  Prepare  Col.  4 from  Table  2-l(B). 

Plot  the  points . 

2.  Sketch  the  envelope  through  the  5%  2.  See  curves  #1  and  #3. 

plotting  points  and  through  the  95% 

plotting  points. 

There  seems  little  point  in  going  on  with  this  analysis,  the  lines  are  so  curved 
that  it  doesn’t  seem  that  the  data  came  from  a s-normal  distribution.  This  conclusion 
is  contrary  to  the  ones  drawn  from  the  K~S  Bounds  method  for  the  same  data.  In  gen- 
eral, one  should  tend  to  believe  theiS^^  Bounds  method. 

In  subsequent  paragraphs,  the  Weibull  and  lognormal  distributions  will  be  tried 
for  Data  Sets  A,  B,  C to  see  if  they  fit  better. 
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Figure  2-3  (A).  Data  Set  C,  s-Normal  Scale.  K-S  Bounds  Method 
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Instructionsfor  Use 


Practical  Probability  Paper 
Evans  Associates 


s-Normal  (Gaussian)  Distribution 


• Plotting  data:  Plot  failure  r at  the  two  points:  F|^|  = r/n  and  = Table  of  K-S  Bounds 

(r  Connect  the  points  with  horizontal  and  vertical  lines;  this  is 

the  sample  Cdf.  n KS^  (sconfidence) 


• Plotting  cumulative-hazard  data:  Plot  failure  r at  the  two  points  F^j 
= 1 — exp(— wp  and  F|_o  = 1 “ exp(— to  convert  the  sample 
cumulative-hazard  to  the  Cdf.  Connect  the  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  s-confidence  boundswill 
not  be  exact. 

• 2-sided  s-confidence  bounds  'on  the  actual  Cdf:  Choose  the 

s-confidence  level,  near  is  reasonable;  then  find  KS^  from  the 

body  of  the  Table  (e.g.,  n=^Q,  s-conf=95%,  KS^=0.41).  The  upper 
bound  is  plotted  at  and  lower  bound  is  plotted 

at  F|-j|— KS^  and  \o  — KS^.  For  each  bound,  connect  the  points  with 
horizontal  and  vertical  lines;  they  will  be  parallel  to,  and  KS^  from,  the 
sample  Cdf,  Then  1— s-conf  is  the  fraction  of  times  youdo-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
s-confidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf, 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

.47 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

,29 

40 

.19 

.21 

.24 

.25 

n 

1_22 

1.36 

1.52 

1.63 

/TtTT 

■J  n-t-1 

\/~n^ 

■J  n+1 

(formula  is  o.k.  for  n>€) 


• Drawing  data-lines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonably  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  n.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  o. 

• To  estimate^:  is  the  value  of  x atwhich  a data-line  intersects  the 

heavy  dashed  line  (F^  = 50.0%). 

• To  estimate  a:  Take  two  values  of  S S.j  and  S2;  then  find  the  two  x 
values,  X.  and  X2,  which  correspond  to  S.|  and  S2,  via  a data-line.  o = 
Ix2  “ X.J  VIS2  — Sp.  I f IS2  — Sp  = 1,  then  a = Ix2  — x.|  I. 


For  censored  samples,  use  an  n which  is  between  the 
original-number+ ,-test  and  the  number-of-failures. 

s-Normal  (Gaussian)  Distribution 

F(x)  = gauf  gauf  (z)  is  the  standard  s-normal 

Cdf 

F Cumulative  distribution  function  (Cdf) 

H location  parameter  (same  units  as  x),  also  the 
median  and  mean  (average) 
a scale  parameter  (same  units  as  x),  also  the  standard 
deviation 
n sample  size 

r failure  number;/-  =1,2,  ...  ,n 
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Figure  2-3  (B).  Data  Set  C,  s-Nornta!  Scale.  Beta  Bounds  Method 
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were  line  #3,  there  could  be  an  appreciable 
number  of  early  failures,  although  the  picture 
doesn’t  look  as  bad  as  it  did  on  s-normal 
paper  (Fig.  2- 1(A)). 

Data  Sets  B and  C,  from  Tables  2-4  and 
2-5  are  plotted  in  Fig.  2-5;  the  K-S  Bounds 
method  is  used,  with  90%s-confidence 
bounds  (A^  = 10,  KS,  = 0.37).  Data  Set  B 
is  the  lower  half  of  the  plotted  points 
(circles);  Data  Set  C is  the  entire  set  of 
points.  For  Data  Set  B,  with  only  half  the 
points,  the  uncertainty  in  the  distribution 
appears  tremendous.  The  lines  are  drawn  for 
Data  Set  C,  the  full  sample.  Following  the 
instructions  on  the  reverse  side  of  Fig.  2-5, 
one  obtains 

Qfi  = 700  hr,  a = 1150  hr,  dy  = 1500  hr 

= 0.55,  ^ = 2.0,  = 3.6 

This  sample  could  easily  have  come  from  a 
Weibull  distribution.  The  characteristie  life 
(a)is  known  to  within  a factor  of  2;  the  B,© 
life  (Cdf=  10%)is  probably  between  10  hr 
and  500  hr. 

Data  Set  D (Table  2-6)  was  simulated  from 
a table  of  pseudo-random  numbers.  The 
procedure  for  plotting  it  on  Weibull  probabil- 
ity paper  using  the  K-S  Bounds  method  is 
shown  in  some  detail;  see  Example  No.  1(F). 

2-2.5  LOGNORMAL  DISTRIBUTION 

There  are  several  forms  for  writing  the 
lognormal  distribution— some  of  them  are 
confusing  because  of  a carryover  from  the 
s-normal  distribution  of  the  (MjO)  notation. 
One  never  quite  knows  whether  p and  a 
refer  to  mean  and  standard  deviation  at  all, 
and  if  they  do,  whether  it  is  to  the  logs  or 
not.  The  form  used  here  is: 

lognormal  Cdf{t  ;oi,0} 

= gauf  [ln((f/a)®)]  (2-13) 


where 

a.  = scale  parameter 

jS  = shape  parameter 

The  distribution  is  discussed  more  fully  in 
par.  2-3.6  and  in  Part  Six,  Mathematical 
Appendix  and  Glossary. 

Figs.  2-7,  2-8,  and  2-9  show  Data  Sets  A, 
[text  continues  on  page  2-36] 

TABLE  2-6 
DATA  SET  D 

This  is  a simulated  data  set  from  random-number 
tables.  N = 2^. 


Rotting  Positions,  % 
(interpolatedfrom 
Table  2-1  (B)  be- 


Time  to 

tween  N=20 

Rank 

failure,  hr 

r/N 

andW  = 22) 

1 

81.6 

4.8 

0.25/3.3/13 

2 

90.8 

9.5 

1.7/7.9/21 

3 

107 

14.3 

4.1/13/28 

4 

118 

19.0 

6.9/17/34 

5 

135 

23.8 

10/22/39 

6 

141 

28.6 

14/27/44 

7 

152 

33.3 

17/31/49 

8 

161 

38.1 

20/36/54 

9 

162 

42.9 

23/41/59 

10 

181 

47.6 

27/45/64 

11 

206 

52.4 

31/50/69 

12 

206 

57.1 

36/55/73 

13 

234 

61.9 

41/59/77 

14 

240 

66.7 

46/64/80 

15 

244 

71.4 

51/69/83 

16 

245 

76.2 

56/73/86 

17 

247 

81.0 

61/78/90 

18 

261 

85.7 

66/83/93.1 

19 

279 

90.5 

72/87/95.9 

20 

279 

95.2 

79/92.1/98.3 

21 

281 

100.0 

87/96.7/99.75 

Column4  is  shown  only  for  completeness;  it  is  not 
illustratedwith  a figure. 

1 - 1//V=  0.952;  use  95%,  s-confidence.  KS,  =0.29 
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Figure  2-4.  Data  Set  A,  \NeibuU  Scale.  K-S  Bounds  Method  (95%  s-Confidence  Bounds) 


s-z 


Instructionsfor  Use 


Practical  Probability  Paper 
Evans  Associates 


Weibull  Distribution 


• Plotting  data:  Plot  failure  r at  the  two  points:  = r!n  and  = 

(r  - D/r?,  Connect  the  points  with  horizontal  and  vertical  lines;  this  is 
the  sample  Cdf. 

• Plotting  cumulative-hazard  data:  Plot  failure  r at  the  two  points 

= 1 — exp(— and  = 1 — exp(— to  convert  the  sample 
cumulative-hazard  to  the  Cdf.  Connect  the  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  s-confidence  boundswill 
not  be  exact. 

• 2-sided  s-confidence  bounds  on  the  actual  Cdf:  Choose  the 
s-confidence  level,  near  1-(1//?)  is  reasonable;  then  find  KS^  from  the 
body  of  the  Table  (e.g.,  n=10,  s-conf=95%,  KS^=0.41).  The  upper 
bound  is  plotted  at  F|_q+KS^  and  F^+KS^;  the  lower  bound  is  plotted 
at  F|^|— KS^  and  F|_g— KS^.  For  each  bound,  connect  the  points  with 
horizontal  and  vertical  lines;  they  will  be  parallel  to,  and  KS^  from,  the 
sample  Cdf.  Then  1-s-conf  is  the  fraction  of  times  you-do-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
s-confidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf, 

• Drawing  data-lines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonably  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  a.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  b. 

• To  estimate  a:  a is  the  value  of  x at  which  a data-line  intersects  the 
heavy  dashed  line  (F^  = 63.2%). 

• To  estimate  b:  Take  two  values  of  x,  x.j  and  y-2,  1 decade  apart; 
then  find  the  two  B values,  B.j  and  B2,  which  correspond t o x.j  and  xj, 
via  a data-line.  b = IB2  — B.j  I.  If  x.j  and  X2  are  d decades  apart,  then  use 
b=  iB2  -ByVd. 


Table  of  K-S  Bounds 


KS^  (sconfidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

A1 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

,31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

,21 

.24 

.25 

n 

1.22 

1.36 

1.52 

1.63 

7/7+1 

7 77+1 

7/7+1 

7 /7+1 

(formula  is  o.k.  for  n>Q) 


For  censored  samples,  use  an  n which  is  between  the 
original-number-on-test  and  the  number-of-failures. 


Weibull  Distribution 

F(x)  = 1 -exp[— (x/a)^] 

F Cumulative  distribution  function  (Cdf) 
a scale  parameter  (same  units  as  x) 
b shape  parameter  (no  units) 
n sample  size 

r failure  number;  r = 1,  2,  ...  ,n 
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Figure  2-5.  Data  Sets  B and  C,  Weibull  Scale.  K-S  Bounds  Method  (90%  s-Confidence  Bounds) 
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Instructions  for  Use 


Practical  Probability  Paper 
Evans  Associates 


Weibull  Distribution 


• Plotting  data:  Plot  failure  r at  the  two  points:  =r/n  and  = 

(r  - ^)ln.  Connect  the  points  with  horizontal  and  vertical  lines;  thfs  is 
the  sample  Cdf. 

• Plotting  cumulative-hazard  data:  Plot  failure  r at  the  two  points  Fj^j 
= 1 — exp(— and  F|_q  = 1 — exp(— to  convert  the  sample 
cumulative-hazard  to  the  Cdf.  Connect  the  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  s-confidence  boundswill 
not  be  exact. 

• 2-sided  s-confidence  bounds  on  the  actual  Cdf:  Choose  the 

s-confidence  level,  near  1-(1/n|  is  reasonable;  then  find  KS^  from  the 
body  of  the  Table  (e.g.,  n=10,  s-conf=95%,  KS^=0.41).  The  upper 
bound  is  plotted  at  and  F|^j-i-KS^;the  lower  bound  is  plotted 

at  F^j— KS^  and  For  each  bound,  connect  the  points  with 

horizontal  and  vertical  lines;  they  will  be  parallel  to,  and  KS^  from,  the 
sample  Cdf.  Then  1 — s-conf  is  the  fraction  of  times  you-do-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
s-confidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf, 

• Drawing  data-lines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonably  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  a.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  b. 

• To  estimate  a:  a is  the  value  of  x at  which  a data-line  intersects  the 
heavy  dashed  line  (F^  = 63.2%). 

• To  estimate  b\  Take  two  values  of  x,  x.|  and  X2<  1 decade  apart; 
then  find  the  two  B values,  B.|  and  B2,  which  correspond t o x.|  and  X2< 
via  a data-line.  b = IB2  — B.|  I.  If  x.|  and  X2  are  d decades  apart,  then  use 
6=  IB2 


Table  of  K S Bounds 


n KS^  (sconfidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

A1 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

,21 

.24 

.25 

n 

1.22 

1.36 

1.52 

1.63 

/J7+I 

/7t+1 

/Tin 

v/TTn 

(formula  iso.k.  forn>6) 


For  censored  samples,  use  an  n which  is  between  the 
original-number-on-testand  the  number-of-failures. 


Weibull  Distribution 

F(x)  = 1 - exp[-(x/a)^] 

F Cumulative  distribution  function  (Cdf) 
a scale  parameter  (same  units  as  x) 
b shape  parameter  (no  units) 
n sample  size 

r failure  number;  r = 1,2,  ... 
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Example  No.  1(F) 

This  example  uses  Data  Set  D,  Table  2—6. 

Data  SetD.  K—S  Bounds  Method  (Table 2—6,  Fig,  2—6) 


Procedure 

1.  Prepare  Col.  3.  Choose  an  s-con- 
fidence  level,  and  find  from  the 
reverse  side  of  Fig.  2—6, 

2.  Plot  the  data  in  Col.  3 and  the 
bounds,  as  indicated  on  the  reverse 
side  of  Fig.  2-6. 

3.  Draw  the  two  parallel  lines  for  es- 
timating the  lower  and  upper  limits 
of  CY,  and  Op.  and  Q!p  are  the 
intersections  of  lines  #1  and  #2 
with  the  heavy  dashed  line. 

4.  Draw  the  two  intersecting  lines  for 
estimating  the  lower  and  upper  lim- 
its of  p,  Pi  and  Pxj.  Pi  and  /3p  are 
calculated  from  the  slopes  of  lines 
#3  and  #4. 


5.  Use  the  "best  fit"  line  to  make  point 
estimates  of  a!  and  p,  a and  P, 


Example 

1.  7^  = 21;  1-  1/N  = 0.952. 

Choose  95%  s-confidence. 

KS„  = 0.29  (from  the  formula). 

2.  See  Fig.  2—6. 

3.  See  lines  #1  and  #2. 

= 170  hr 
Q!p  = 280  hr. 

4.  For  line  #3,  choose  the  decade  from 

30  to  300.  Bi  =2.05,  =3.10; 

thus  =3.10  - 2.05  = 1.05.  For 
line  #4,  choose  the  half-decade  from 
100to316.  = 1.  10,  .Bj  = 3.90; 

thus  pp  = (3.90  -l,10)/0.5  =5.6. 

5.  From  line  *5 : 
a = 220  h r 

P = 3.0. 


These  data  could  easily  have  come  from  aWeibull  distribution,  although  the  data 
do  not  lie  on  a very  straight  line.  The  parent  population  actually  was  Weibull,  with 
a!  = 200  hr  and  P = 2.5.  This  line  (not  shown  in  Fig.  2—6)  is  well  within  the  it— S en- 
velope, but  is  not  a good  fit  to  the  data  points.  The  data  themselves  do  not  lie  well  on 
their  best-fit  line  (#5).  De  very  skeptical  when  the  data  do  lie  on  a nice  straight  line; 
someone  may  have  given  the  data  a preliminary  manipulation. 
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Example  No  .1  (F)  (Cont’d) 

Do  not  use  graphical  methods  to  estimate  a location  parameter  for  the  Weibull 
distribution;  you  will  only  be  playing  a losing  game  with  random  numbers,  ff  you 
must  estimate  a location  parameter  for  the  Weibull  distribution,  consult  a competent 
statistician.  The  arithmetic  manipulations  can  easily  be  done  precisely  (on  a com- 
puter); but  it  is  so  easy  to  mislead  oneself. 

The  big  lesson  to  be  learned  from  Data  SetD  is  that  a random  sample  of  about 
20  points  or  less  can  only  give  ballpark  estimates  — you  learn  the  name  cf  the  game 
and  where  it’s  being  played,  that’s  all. 
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Figure  2-6.  Data  Set  D,  Weibulf  Scale.  K-S  Bounds  Method  (95%  s-Canfidence  Bounds) 
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Instructionsfor  Use 


Practical  Probability  Paper 
Ev<iii:>  Associates 


Weibull  Distribution 


• Plotting  data:  Plot  failure /■  at  the  two  points;  F^|  =/•//»  and  = 
{r  - ^)/n.  Connect  the  points  with  horizontal  and  vertical  lines;  this  is 
the  sample  Cdf. 

• Plotting  cumulative-hazard  data:  Plot  failure  r at  the  two  points  F^| 
= 1 — exp(— and  F(_^  = 1 — exp(—H^_^)  to  convert  the  sample 
cumulative-hazard  to  the  Cdf.  Connect  the  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  s-confidence  boundswill 
not  be  exact. 

• 2-sided  s-confidence  bounds  on  the  actual  Cdf;  Choose  the 

s-confidence  level,  near  1-{1/rt)  is  reasonable;  then  find  KS^  from  the 
body  of  the  Table  (e,g„  /7=10,  i-conf=95%,  KS^=0.41).  The  upper 
bound  is  plotted  at  and  F^j+KS^;the  lower  bound  is  plotted 

at  and  For  each  bound,  connect  the  points  with 

horizontal  and  vertical  lines;  they  will  be  parallel  to,  and  KS^  from,  the 
sample  Cdf,  Then  1 — s-conf  is  the  fraction  of  times  you-do-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
sconfidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf, 

• Drawing  data-lines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonably  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  a.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  b. 

• To  estimate  a:  a is  the  value  of  x at  which  a data-line  intersects  the 
heavy  dashed  line  ( F^  = 63.2%). 

• To  estimate  b\  Take  two  values  of  x,  x.j  and  X2,  1 decade  apart; 
then  find  the  two  B values,  B.^  and  82,  which  correspond  1 0 x.j  and  X2, 
via  a data-line.  b = 102  — B.|  i.  Ifx.j  and  X2  are  d decades  apart,  then  use 
b=  182  -ByVd. 


Table  of  K-S  Bounds 


n KS^  (sconfidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

.47 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

.21 

.24 

.25 

n 

1.22 

1.36 

1.52 

1.63 

J /7+I 

J /7+I 

JHV\ 

\f7TPi 

(formula  iso.k.  for/r>6) 


For  censored  samples,  use  an  n which  is  between  the 
original-number-on-testand  the  number-of-failures. 


Weibull  Distribution 

F(x)  = 1 -exp[-(x/a)*] 

F Cumulative  distribution  function  (Cdf) 
a scale  parameter  (same  units  as  x) 
b shape  parameter  (no  units) 
n sample  size 

r failure  number;  r = 1,  2,  ...  ,n 
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C,  and  D plotted,  respectively,  on  lognormal 
probability  paper  using  the  K-S  Bounds 
method.  The  s-confidence  levels  are  the 
same  as  used  for  the  same  data  sets  in  earlier 
paragraphs.  See  instructions  for  use  on  the 
reverse  side  of  the  Practical  Probability  Paper. 

Data  Set  A (Fig.  2-7)  could  reasonably 
have  come  from  a lognormal  distribution. 

The  parameter  estimates,  from  lines  #l-#5 
are; 

= 1450  hr,  a = 1900  hr, 

= 2400  hr 

/3j^-4.0,  ^ = 11,  27  . 

Data  Set  C (Fig.  2-8)  could  reasonably 
have  come  from  a lognonnal  distribution. 

No  parameter  estimates  were  made  because 
they  would  serve  little  purpose.  The  reason 
Data  Set  C could  reasonably  have  come  from 
a lognormal  distribution  is  that  a variety  of 
straight  lines  could  be  drawn  within  the  K-S 
envelope  in  Fig.  2-8.  Anyone  of  those  lines 
could  be  the  actual  distribution. 

Data  Set  D (Fig.  2-9)  could  reasonably 
have  come  from  a lognormal  distribution. 

No  parameter  estimates  were  made. 

Small  samples  (e.g.,  20  or  less)  cannot  pin- 
point the  distribution  from  whence  they 
came.  Lognormal  and  Weibull  distributions 
are  difficult  to  tell  apart  even  with  somewhat 
larger  samples. 

2-2.6  SUMMARY 

Small  samples  (say,  less  than  20)  are  noto- 
riously unreliable  indicators  for  the  shape  of 
a population.  Always  plot  the  K-S  bounds 
along  with  the  sample  Cd/.  Figs.  2-10  and 
2-11  show  the  behavior  of  samples  from  the 
uniform  distribution  (see  Ref  27).  Fig.  2-10 
shows  the  first  1 0 order  statistics  out  of  a 
sample  of  99  (the  plots  are  \s  the  mean 


plotting  value  from  Eq.  24).  The  horizontal 
and  vertical  scales  are  the  same;  so  the  pop- 
ulation (shown  solid)  plots  as  a 45-deg 
straight  line.  Fig.  2-1 1 shows  all  9 order 
statistics  from  a sample  of  9.  Again,  the 
horizontal  and  vertical  scales  are  the  same; 
so  the  population  plots  as  a 45-deg  straight 
line.  (The  K-S  bounds  are  not  shown  here 
in  this  special  case,  so  as  not  to  clutter  up 
the  figures.) 

All  3 data  sets  (A,C,D)  could  reasonably 
have  come  from  any  of  the  3 distributions: 
s-normal,  Weibull,  or  lognormal.  It  is  fruit- 
less to  try  to  pick  the  “best”  one;  that  would 
be  an  exercise  in  sterile,  pointless  mathe- 
matics. 

Before  you  pursue  the  questions  of  which 
distributions  and  what  parameter  values,  ask 
yourself  “Why  do  1 want  to  know?”  If  it’s 
because  you  want  to  estimate  some  property 
of  the  population,  stop.  You’re  kidding 
yourself  if  you  think  mathematical  manipula- 
tions will  tell  you  the  answer  when  the  graph 
says  you  don’t  know. 

Do  not  try  to  estimate  a location  param- 
eter for  Weibull  and  lognormal  distributions 
by  trying  to  “straighten-out”  the  sample  plot. 
If  you  are  ever  tempted  to  do  it,  look  again 
at  Figs.  2-10  and  2-1  1 which  show  how  “un- 
typical” a random  sample  usually  is. 

Graphical  estimation  usually  can  provide 
all  the  accuracy  that  the  data  can  use.  It 
can  give  a good  picture  of  the  uncertainty  in 
any  extrapolation  (or  interpolation)  from 
the  sample.  It  can  also  make  you  think 
harder  about  why  you  wanted  to  estimate 
some  parameters  from  the  data.  When  an 
iterative  analytic  method  is  used  to  estimate 
parameters,  the  graphical  estimates  are  usu- 
ally excellent  choices  tor  the  starting  point. 

Beware  of  data  from  small  samples  that 
plot  as  very  straight  lines  on  any  kind  of 
probability  paper.  The  chances  of  its  hap- 
[text  continues  on  page  2-49] 
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Figure  2-7.  Data  Set  A,  Lognormal  Scale.  K-S  Bounds  Method  (95%  s-Confidence) 


2-38 


Practical  Probability  Paper 

Instructionsfor  Ute  Evans  Associates 

Lognormal  Distribution 

• Plotting  data:  Plot  failure  r at  the  two  points:  F|-|j  = rin  and  = 

(r  - 1)//7.  Connect  the  points  with  horizontal  and  vertical  lines;  this  is 
the  sample  Cdf. 

• Plotting  cumulative-hazard  data:  Plot  failure  r at  the  two  points 

= 1 — exp(— Wp  and  F|_o  ~ 1 to  convert  the  sample 

cumulative-hazard  to  the  Cdf.  Connect  the  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  sconfidence  boundswill 
not  be  exact. 

• 2-sided  s-confidence  bounds  on  the  actual  Cdf:  Choose  the 

s-confidence  level,  near  is  reasonable;  then  find  KS^  from  the 

body  of  the  Table  (e.g.,  n=10,  s-conf=95%,  KS^=0.41).  The  upper 
bound  is  plotted  at  Fio+KS^andF  l^j+KS^;  the  lower  bound  is  plotted 
at  bound,  connect  the  points  with 

horizontal  and  vertical  lines;  they  will  be  parallel  to,  andKS^  from,  the 
sample  Cdf,  Then  1-s-conf  is  the  fraction  of  times  youdo-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
s-confidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf, 

• Drawing  data-lines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonably  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  a.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  b, 

• To  estimate  a:  a is  the  value  of  x at  which  a data-line  intersects  the 
heavy  dashed  line  (F^  = 50,0%). 

• To  estimate  b:  Take  two  values  of  x,  x.j  and  X2,  1 decade  apart; 
then  find  the  two  B values,  B .j  and  B2,  which  correspond  to  x.|  andx2, 
via  a data-line. b = IB2  - B.j  I.  If  x.j  and  X2  are  d decades  apart,  then  use 
b=  IB2  -B.,l/cy. 


Table  of  K-S  Bounds 


n KS^  (sconfidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

.47 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

.21 

.24 

.25 

n 

1.22 

1.36 

1.52 

1.63 

•J  n-t-1 

v/TTFT 

'JlrM\ 

J n+l 

(formula  is  o.k.  for  n>6) 

For  censored  samples,  use  an  n which  is  between  the 
original-numberan-test  and  the  number-of-failures. 


Lognormal  Distribution 

F(x)  = gauf  (logg[(^)^]),  gauf  (z)  is  the  standard 
s-normal  Cdf 

F Cumulative  distribution  function  (Cdf) 
a scale  parameter  (same  units  as  x),  also  the  median; 

log  a is  the  median  and  mean  (average)  of  log^x 
b shape  parameter  (dimensionless);  Mb  is  the 
standard  deviation  of  logg  x 
n sample  size 

r failure  number; r = 1,  2 n 
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Figure  28.  P-t?d  Set  (J;  Lognormal  Scale.  K-S  Bounds  Method  (90%  s-Confidence) 
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Instmctionsfor  Use 
Lognormal  Distribution 


Practical  Probability  Paper 
Evans  Associates 


• Plotting  data:  Plot  failure  r at  the  two  points:  =r!n  and  = 

(r  - 1)/n.  Connectthe  points  with  horizontal  and  vertical  lines;  this  is 
the  sample  Cdf. 

• Plotting  cumulative-hazard  data:  Plot  failure  r at  the  two  points  F^^l 

= 1 — exp{—H^)  and  = 1 — exp  to  convert  the  sample 

cumulative-hazard  to  the  Cdf.  Connectthe  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  s-confidence  bounds  will 

not  be  exacri. 


• 2-sided  s-confidence  bounds  on  the  actual  Cdf:  Choose  the 

s-confidence  level,  near  1-(1/n)  is  reasonable;  then  find  KS^  from  the 
body  of  the  Table  (e.g.,  n=10,  s-conf=95%,  KS^=0.41j.  The  upper 
bound  is  plotted  at  and  lower  bound  is  plotted 

at  Fi-!i“*^^n  bound,  connectthe  points  with 

horizontal  and  vertical  lines;  they  will  be  parallel  to,  and  KS^  from,  the 
sample  Cdf,  Then  1 — s-conf  is  the  fraction  of  times  youdo-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
s-confidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf, 

• Drawing  data-lines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonably  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  a.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  b. 

• To  estimatea;  a is  the  value  of  x at  which  a data-line  intersects  the 
heavy  dashed  line  (F^  = 50.0%). 

• To  estimate  b:  Take  two  values  of  x,  x,j  and  X2>  decade  apart; 
then  find  the  two  B values,  B,j  and  B2,  which  correspondto  andx2> 
via  a data-line.  b = IB2  — B.j  I.  If  and  X2  are  d decades  apart,  then  use 
b = IB2  - B.,  I/d. 


Table  of  K-S  Bounds 


n KS^  (s-confidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

.47 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

to 

.37 

.41 

40 

,49 

52 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

.21 

.24 

.25 

n 

1.22 

1.36 

1.52 

1.63 

/■/tTT 

jirn 

J /7-t-l 

v/Tj+T 

(formula  is  o.k.  for  n>Q) 

For  censored  samples,  use  an  n which  is  between  the 
original-number-on-test  and  the  number-of-failures. 


Lognormal  Distribution 

F(x)  = gauf  (logg[(^)^]),  gauf  (z)  is  the  standard 
s-normal  Cdf 

F Cumulative  distribution  function  (Cdf) 
a scale  parameter  (same  units  as  x),  also  the  median; 

loga  isthe  median  and  mean  (average)of  loc^ 
b shape  parameter  (dimensionless);  Mb  is  the 
standard  deviation  of  logg  x 
n sample  size 

r failure  number;/- = 1,  2 n 
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Figure  2-9.  Data  Set  D,  Lognormal  Scale,  -^.5  Bounds  (95%  s-Confidence) 
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Practical  Probability  Paper 

Instructionsfor  Use  Evans  Associates 

Lognormal  Distribution 

• Plotting  data:  Plot  failure  r at  the  two  points:  F|^|  =r!n  and  = 

(r  - 1)//7.  Connect  the  points  with  horizontal  and  vertical  lines;  this  is 
the  sample  Cdf. 

• Plotting  cumulative-hazard  data:  Plot  failure  r at  the  two  points  F^l 
= 1 — exp(-W^)  and  F|_q  = 1 — exp  (— to  convert  the  sample 
cumulative-hazard  to  the  Cdf.  Connect  the  points  with  horizontal 
and  vertical  lines;  this  is  the  sample  Cdf.  The  s-confidence  boundswill 
not  be  exact. 

• 2-sided  s-confidence  bounds  on  the  actual  Cdf:  Choose  the 

s-confidence  level,  near  1-(1//7)  is  reasonable;  then  find  KS^  from  the 
body  of  the  Table  (e.g.,  n=10,  s-conf=95%,  KS^=0.41).  The  upper 
bound  is  plotted  at  F|_q-i-KS^  and  Fj^I+KS^;  the  lower  bound  is  plotted 
at  ®3Ch  bound,  connect  the  points  with 

horizontal  and  vertical  lines;  they  will  be  parallel  to,  and  KS^  from,  the 
sample  Cdf,  Then  1 — s-conf  is  the  fraction  of  times  youdo-this- 
procedure  that  the  true  Cdf  will  partly  lie  outside  the  2-sided 
s-confidence  bounds.  In  general,  you  will  be  disheartened  at  how  little 
you  know  about  the  true  Cdf, 

• Drawing  data-lines:  Draw  the  two  parallel  lines,  farthest  apart,  that 
fit  reasonably  within  the  s-confidence  bounds;  use  both  to  estimate 
bounds  on  a.  Draw  the  two  intersecting  lines,  with  steepest  and  smallest 
slopes,  that  fit  reasonably  within  the  s-confidence  bounds;  use  both  to 
estimate  bounds  on  b. 

• To  estimate  a:  a is  the  value  of  x at  which  a data-line  intersects  the 
heavy  dashed  line  (F^  = 50.0%). 

• To  estimate  b\  Take  two  values  of  x,  and  X2,  1 decade  apart; 
then  find  the  two  B values,  8 ,|  and  82,  which  correspondto  x.j  andx2, 
via  a data-line.  b=lB2— B.|l.  Ifx.j  and  X2  are  d decades  apart,  then  use 
b = IB2  - 8.,  \!d. 


Table  of  K-S  Bounds 


n KS^  (s-confidence) 


(90%) 

(95%) 

(98%) 

(99%) 

5 

.51 

.56 

.63 

.67 

6 

.47 

.52 

.58 

.62 

8 

.41 

.45 

.51 

.54 

10 

.37 

.41 

.46 

.49 

12 

.34 

.38 

.42 

.45 

14 

.31 

.35 

.39 

.42 

16 

.30 

.33 

.37 

.39 

18 

.28 

.31 

.35 

.37 

20 

.26 

.29 

.33 

.36 

30 

.22 

.24 

.27 

.29 

40 

.19 

.21 

.24 

.25 

n 

1.22 

1.36 

1.52 

1.63 

J7rf^ 

v/TtTT 

v/TFFT 

v/TTFT 

(formula  is  o.k.  for  n>6) 

For  censored  samples,  use  an  n which  is  between  the 
original-number-on-test  and  the  number-of-failures. 


Lognormal  Distribution 

F(x)  = gauf  (logg[(^)*]),  gauf  (z)  is  the  standard 
s-normal  Cdf 

F Cumulative  distribution  function  (Cdf) 
a scale  parameter  (same  units  as  x),  also  the  median; 

log  a is  the  median  and  mean  (average)  of  logeX 
b shape  parameter  (dimensionless);  1/6  is  the 
standard  deviation  of  bg,  x 
n sample  size 

r failure  number; r = 1,2,  ...  ,n 


AMCP  706-198 


AMCP  706-198 


66  JO  Joo  OT  :3lduiBs  ‘X^fXTq^qoaa  iBn^oy 


244 


Figure  2-10.  {Cant'd) 


Figure  2-11.  Random  Samples,  Complete  9 Out  of  9 ( Ref.  27) 


Actual  Probability,  %;  Sample:  9 out  of  9 

H*  roWi^Ln9>>-sJ0D  kO  v£) 


861301:  dOnV 


Actual  Probability,  %;  Samjule; 


Figure  2-11.  (Cont'd) 
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pening  without  human  assistance  are  very 
small.  Be  suspicious  that  the  data  are  not 
fully  legitimate. 

More  information  on  graphical  analysis  is 
given  in  Refs.  28-29. 

2-3  ANALYTIC  ESTIMATION  OF  PARAM- 
ETERS OF  A DISTRIBUTION 

This  material  is  covered  in  detail  in  Part 
Six,  Mathematical  Appendix  and  Glossary. 
Some  of  the  material  is  summarized  here  for 
easy  reference.  It  is  often  worthwhile  plot- 
ting the  sample  results  from  a continuous 
distribution  on  graph  paper  as  mentioned  in 
par.  2-2.  This  ought  to  be  done  before 
analytic  estimation. 

When  the  random  variable  is  discrete,  s- 
confidence  limits  are  more  difficult  to  use 
and  their  exact  statement  is  more  compli- 
cated. 

2-3.1  BINOMIAL 

The  discrete  random  variable  k is  the  num- 
ber of  occurrences  of  an  attribute  in  N s- 
independent  trials,  when  the  attribute  must 
be  in  either  of  2 mutually  exclusive  catego- 
ries. 

Use  the  following  notation 

k\,  k2  ~ number  of  trials  with  result 
#1  or  result  #2,  respectively 

- probability  of  result  #1  or 
result  #2,  respectively,  in  each 
and  every  trial 

N = number  of  s-independent  trials 

The  auxiliar\'  relationships  are 

k^  + k2=N  (2 -14a) 

Pi  +P2  = 1 


The  probability  mass  function  pmf  is 

pmf{k.,k2-,PuP2^N}  = 

(2-15) 

This  symmetric  form  is  easy  to  remembei. 

The  means  and  variances  are 

E{ki}=  Npi  for  i - i,  2 t2-16) 

YsiT{ki}  = NpiP2  (2-17) 

The  usual  statistical  problem  is  to  estimate 
Pi,  P2-  Most  often  it  is  simplest  to  estimate 
the  smaller  of  the  two,  especially  since  con- 
venient approximations  are  applicable  when 
the  Pi  being  estimated  is  small.  In  reliability 
work,  the  2 categories  are  usually  Good,  Bad 
(or  something  equivalent).  Since  the  fraction 
Bad  is  ordinarily  small  (if  not,  the  lack  of 
precision  in  estimating  that  fraction  is  of 
little  concern),  it  is  the  parameter  to  be  esti- 
mated. The  maximum  likelihood,  unbiased 
estimate  p,-  of  p,-  is 

Pi  = ki/N  (2-18) 

5-Confidence  limits  are  somewhat  difficult 
to  calculate.  If  Pj-  <0.1  and  N > 10,  the 
Poisson  approximation  (par.  2-3.2)  is  usually 
adequate  and  is  easier  to  use.  If  this  is  not 
feasible.  Table  41  of  Ref  30  or  Chapter  7 
of  Ref  1 8 w ill  give  adequate  answers.  In 
that  situation  (N  < 10,p  > 0.1)  no  engineer 
really  cares  exactly  what  the  situation  is 
because  (a)  probabilities  of  failure  greater 
than  0. 1 are  generally  bad,  and  (b)  the  un- 
certainty in  p is  going  to  be  so  high  that  it 
is  usually  pointless  (for  engineers)  to  make 
exact  calculations.  If  a contractual  relation- 
ship is  involved,  a statistician  ought  to  be 
consulted.  For  very  rough  estimates  of  un- 
certainty, estimate  a from  Eq.  2-17  using 
Pi  = Pi- 

a = Npip2  (2-19) 


(2-14b) 
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The  s-confidence  level  associated  with  a 
“±la  range”  usually  will  be  roughly  50%- 
80%,  (the  s-normal  tables  will  not  give  a 
correct  answer).  Example  No.  2 illustrates 
the  procedure  for  obtaining  ^--onfidence 
limits. 

2-3.2  POISSON 

The  discrete  random  variable  k is  the  num- 
ber of  events  which  occur  in  a fixed  set  of 
circumstances.  Examples  are  the  number  of 
defects  in  3.5  yd^  of  cloth,  the  number  of 
failures  during  a 12-hr  test,  and  the  number 
of  accidents  per  driver  in  10  yr.  If  the 
variable  k has  the  Poisson  distribution,  the 
process  that  generates  k is  often  called  a 
Poisson  process.  In  a Poisson  process,  it  is 
sometimes  convenient  to  define  a rate  param- 
eter, e.g.,  the  number  of  defects  per  square 
yard  of  cloth,  thd  number  of  failures  per 
hour,  or  the  number  of  failures  per  driver 
per  year. 

Use  the  following  notation: 

poi*  = base-name  for  Poisson  distribution; 
the  is  replaced  by  to  denote 
the  pm f by  f to  denote  .the  Cdf 
or  by  fc  to  denote  the  Sf 

k = number  of  events  which  occur 
(must  be  a non-negative  integer) 

M = mean  number  of  events 

The  probability  mass  function  pmf,  the 
Cdf  and  Sf  are 

poim{k',ix)  =pmf{k;p} 

= exp  (—  p)p^/k\  (2-20a) 

poif(k-,fx)  = Cdf{k-,fx} 

k 

= poim{i\  p,)  (2-20b) 

1=0 


P0ifc(k;p)  = S/{fe;)u} 

OO 

= poim{i;fj.)  (2-20c) 
i=k 

The  poif  and  poifc  in  Eq.  2-20  can  be  ex- 
pressed in  terms  of  the  chi-square  Cdf  and 
Sf,  csqf  and  csqfc.  (See  Part  Six,  Mathe- 
matical Appendix  and  Glossary.) 


poifc{k-,fj.)  - csqf(2ix ; 2k) 

(2-21a) 

poifik;  fj.)  - csqfc(2n-,2k  + 2)  (2-21b) 

The  mean  and  variance  are 

E{k}=p 

(2-22a) 

Var{k}  = tj. 

(2-22b) 

The  usual  statistical  problem  is  to 
jU-  The  Poisson  distribution  often 
an  approximation  to  the  binomial 
with 

estimate 
is  used  as 
distribution 

p =pN 

(2-23) 

and  thus  the  statistical  problem  may  be  to 
estimate/?.  Eq.  2-23  is  satisfactory  foriV 
large  (say,  N > 10)  and  p small  (say, 
p < 0.1 ),  and  even  works  reasonably  well 
when  those  conditions  are  violated. 

The  maximum  likelihood,  unbiased  esti- 
mate M of  M is 

jl  = k (2-24) 

Calculating  s-confidence  limits  for  q is 
more  complicated  than  when  the  random 
variable  is  continuous.  A good  explanation 
is  given  in  Part  Six,  Mathematical  Appendix 
and  Glossary.  2-sided  s-confidence  state- 
ments for  q are  of  the  form 

Conf{jUl  ^ ^ Mu}  ^ C (2-25a) 
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Example  No.  2 


Fifty  emergency  flares  were  fired  with  46  successes  and  4 failures.  Estimate 
the  failure  probability.  Find  some  s-confidence 


Procedure 


Example 


1.  State  the  experimental  1.  N = 50,  ki  =4,  ^2  =46. 

data. 

2.  Estimate&  from  Eq.  2.  pi  = 4/50  = 8.0%. 

2-18. 


3.  Find  s-confidence  limits  3.  Since iV-  10and^<0.1,  see  par.  2—3.2, 
by  use  of  Poisson  approx- 
imation. 


4.  From  Example  No.  3 in 
par.  2—3.2,  calculate  the 
limits  for  pi. 


4.  Pt,L-  = 1.37/50  = 2.7%;  pt,L*  = 1-  97/50  = 3.9% 
Pt,u-  = 7.76/50  = 15.5%:  p^^^*  = 9.16/50  = 18.3%. 


5.  Make  the  corresponding 
s-confidence  statements. 


5.  Conf(2.7%  ^Pi^  18.3%)  2:  90% 

Conf{3.9%  ^ 15.5%)  ^ 90%. 


One  conclusion  from  this  experiment  and  analysis  is  that  it  is  difficult  to  find  out 
much  about  probabilistic  parameters  by  conducting  small  experiments. 
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Conf  ^ My}  - C (2-25b) 

where  for  symmetrical  intervals,  C ’ is  defined 
by  the  equation  1 - C’  = (1  — C)/2,  and  the 
s-confidence  limits  nj , , My  are  de- 

fined by 

poifc{k-,ix'u)  = csqf{2ixy-,2k) 

= C , for  J:  0 (2-25c) 

1 — poif(k-,  iXy)  = csqf{2ixy-,  2k  + 2)  = C 

(2-25d) 

and 

poifc{k;ixl)  = csqf(2t^l,2k) 

= 1-  C’,  for  A:  ^ 0 (2-25e) 

1 — poifik-,  k'l)  = csqf{2ix\-,2k  + 2) 

= 1 - C'  (2-25f) 

The  case  for  A = 0 is  different;  symmetrical 
s-confidence  limits  have  no  meaning  (because 
the  poifc  (0;m)  = 1;  regardless  of  the  value  of 
M.  The  1-sided  s-confidence  statements  for 
M are  of  the  form 

Conf  {m  2 Myj^C  (2-25g) 

Conf{Mi-M}-  C (2-251i) 

where  m/  and  My  are  defined  by 
1 — poif(0-,  Hij)  = csqf{2ix}j-,  2) 

= 1 ” exp  (—  2/lcu)  = C 
(2-2  5i) 

1 — poif(0-.  Mi)  = csqf{2ix\-,  2) 

= 1 — exp  (-  2mx) 

= 1 _ C (2-25j) 


The  M^  and  M~  are  seen  to  be  different 
because,  for  discrete  variables,  the  Sf  and 
Cdfare  not  complementary.  While  Eq.  2-25 
looks  complicated,  its  application  in  practice 
is  very  straightforward;  see  Example  No.  3. 

In  most  reliability-statistics  theory,  only 
Eq.  2-25 a is  given  (not  Eq.  2-25b)  and  the 
inequality  often  is  implied  rather  than  being 
explicit.  It  seems  wiser  to  make  as  much 
use  of  the  information  as  we  can,  and  thus 
to  use  both  the  Eqs.  2-25a  and  2-25b,  and 
to  make  the  inequalities  therein,  explicit. 

Other  kinds  of  s-confidence  statements 
are  feasible  although  not  usually  made.  For 
example,  in  Eqs.  2-25a  and  2-25b  we  could 
use  a single  pair  of  M/,  and  My,  then  use  a 
C*  in  Eq.  2-25a  and  a C~  in  Eq.  2-25b. 
Example  No.  4 illustrates  the  procedure. 

Often  it  is  desired  to  estimate  the  Poisson 
parameter  rather  than  the  mean  number  of 
events.  It  is  easily  found  by  the  following 
formula 

\=P/to  (2-26) 

where 

X = Poisson  rate  parameter  (in  reliability 
work,  it  is  virtually  always  the 
failure  rate) 

= fixed  characteristic  of  test,  such  as 
length-of-time  .or  area  of  inspection 

Example  No.  5 illustrates  the  procedure. 

Now  let  us  consider  life  test  applications. 
Wlien  the  failure  rate  is  constant,  in  Eq. 
2-26  is  interpreted  as  the  total  operating 
time  of  all  units,  it  makes  no  difference 
what  kind  of  censoring  is  employed  (if  any) 
nor  whether  the  test  is  with  or  without  re- 
placement; the  only  requirement  is  that 
be  fixed  in  advance  of  the  test.  This  para- 
graph applies  whether  units  are  tested  to 
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Example  No.  3 

In  a particular  test,  4 events  were  observed.  Assume  that  the  process  is 
Poisson.  Estimate  the  true  mean  and  investigate  some  s-confidence  statements  for 
the  true  mean. 

Procedure  Example 


1.  State  the  test  result. 

Find  a good  point  estimate  of  M • 

2.  Investigate  the  s-confidence  state- 
ments; use  Eq.  2-25.  Choose  the 
s-confidence  level.  Calculate  the 
degrees-of-freedom  for  the  chi- 
square  tables. 

3.  Pick  the  appropriate  values 
from  a table. 


4.  The  Mi  and  Mu  are  calculated  4. 

from  the  appropriate  Xp,i^  in 

step  3. 

5.  Make  the  two  s-confidence  state-  5. 

ments  (from  Eqs.  2-25aand 

2-25b). 


1.  k = 4 

M = =4. 

2.  Choose  C = 90%;  so  C'  = 95%  and 

1 “ C'  = 5%.  The  choice  is  largely  a 
personal  matter. 

Since  A:  =4,  we  have  2k  = S and 
2A  +2  = 10. 

3.  From  Table  2-7,  we  have 
xi%,8  = 2-733  for  Eq.  2-25e 
X3%,io  =^-^40  for  Eq.  2-25f 
X95%,8  = 15.51  for  Eq.  2-25c 

n = 1-37,  Mi  = 1.97 
Mu  = 7.76,  Mu  =9.16. 

Conf{l.37  <9.16}^  90% 

Conf  {1.97  < M ^ 7.76}-  ^ 90%. 


It  is  readily  seen  that  the  true  mean  is  not  known  very  well. 
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Example  No.  4 

In  a 1000  hr  test,  no  failures  were  observed.  Assume  that  the  process  is 
Poisson.  Estimate  the  true  mean  and  investigate  some  s-confidence  statements  for 
the  mean. 


Procedure 


Example 


1.  State  the  test  result. 


1.  k=0 


Find  a point  estimate  of  M . 


M = k =0. 


2.  Investigate  the  s-confidence  statements; 
use  Bq.  2-25. 


2.  Choose  C = 95%.  Since  1:  = 0, 
the  intervals  will  be  1-sided. 


3.  Pick  appropriate  values  of  and 

Use  Eqs.  2— 25i  and  2-25j.  Table  2—7 
will  suffice. 


3.  = 0.1026/2  = 0.0513 

Hu  = 5.991/2  =3.00. 


4.  Make  the  two  s-confidence  statements 
(from  Eqs.  2— 25g  and  2— 25h). 


4.  Conf{iU  ^3.00}2:  95% 
Conf  {0.0513  s p}  < 95%. 


These  s-confidence  statements  in  step 4 and  the  point  estimate  in  step  lare  of 
little  help.  Much  has  been  written  for  this  case  (no  failures)  about  estimating  m,  but 
much  of  it  is  fruitless  because  it  tries  to  give  the  illusion  of  more  certainty  when 
there  is  nothing  but  vast  uncertainty.  Randomized  s-confidence  limits  can  often  con- 
siderably narrow  the  region  of  uncertainty  (see  Part  Six  Mathematical  Appendix  and 
Glossary).  The  tw'O  statements  in  step  4 cannot  be  combined  into  one  statement  with 
an  upper  and  lower  limit;  the  first  one  is  the  one  usually  given. 


Example  No.  5 

Use  data  in  Example  No.  4;  estimate  the  failure  rate. 


PrnreHiire 

1.  Calculate  the  point  estimate. 

2.  Calculate  the  interval  estimates 

3.  Make  the  complete  s-confidence 
statements. 


Example 

1.  X=  ju/lOOO-hr  = 0. 

2.  =Mp/l000-hr  = 3.0/1000  hr 

= #ii/l000-hr  = 0.  051/1000  hr. 

3.  Conf  {a  ^ 3.  0/1000  hr}  ^ 95% 
Conf  {O.  051/1000  hr  ^ A}  ^ 95%. 
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TABLE  2-7 

THE  5th  AND  95th  PERCENTILES 
OF  THE  CHI-SQUARE  DISTRIBUTION 

csqf  (x^  -,v)  = Cdf  I x^  ;i^)} 

The  body  of  the  table  gives  the  values  of 

such  that  csqf  p j,  ;v)  = P,  for  P = 5% 

and  95%.  The  table  has  been  abbreviated 
(from  more  extensive  tables)  for  easy  use  in 
the  examples. 


v\P 

5% 

95% 

2 

0.1026 

5.991 

4 

0.7107 

9.487 

6 

1.635 

12.59 

8 

2.733 

15.51 

10 

3.940 

18.31 

12 

5.226 

21.03 

first  failure  and  then  disearded,  or  whether 
units  are  repaired;  the  only  requirement  is 
that  X be  a eonstant,  i.e.,  the  process  is 
Poisson.  This  situation  is  related  to  par. 
2-3.3  on  the  exponential  distribution  since 
both  deal  with  a Poisson  process. 

2-3.3  EXPONENTIAL 

The  continuous  random  variable  t is  the 
time  to  first  failure  (time  of  failure-free 
operation).  It  is  related  to  the  Poisson 
process  of  par.  2-3.2,  but  instead  of  count- 
ing events  (e.g.,  defects  or  failures),  the  time 
to  the  first  failure  (area  to  first  defect)  is 
measured. 

Use  the  following  notation: 

X = failure  rate  (Poisson  rate  parameter) 
t = time  to  failure 
0 = 1/X  (often  used  for  convenience) 

The  pdf  and  Sf  are 


pdf{t\  X}  = X exp  (—  X^) 


= (1/ 0)  exp  (—  t/ 0) 

(2-27  a) 

S/{f;  X}  = exp  (—  Xt)  = exp  (— 

t/e) 

C2-27b) 

The  mean  and  variance  are 

II 

II 

(2-28a) 

Yar{t  } = !/>?  = 0^ 

(2-28b) 

The  usual  statistical  problem  is  to  estimate 
X (or  6).  Tests  are  often  run  until 
ures  have  been  observ'ed.  Then  the  maximum 
likelihood,  unbiased  estimate  6 for  6 is 

e = t^ko  (2-29) 

where  = total  operating  time  up  to  fail- 
ure ko- 

The  reciprocal  of  0 is  the  maximum  likeli- 
hood estimator  for  X,  but  it  is  no  longer 
unbiased. 

s-Confidence  statements  about  X are  found 
from  the  fact  that  2 ko  (X/X)  has  a chi-square 
distribution  with  2 kg  degrees-of-freedom. 

An  equivalent  statement  is  that  X/X  has  a 
chi-square/nu  distribution  with  2 ko  degrees- 
of-freedom.  For  a 2-sided  symmetrical  s- 
confidence  interv  al,  we  have 

ConfjXi,  < .4  ^ Xy}  = C (2-30a) 

where  C is  defined  by  the  equation 
1 — C'  = (1  — C)/2,  and  X^  and  Xy  are 
defined  by 

csgf(2ko\u/^-,  2fefl)  = C'  (2-30b) 

csc?/(2feoXi/X;2feo)  = 1 - C'  (2-30c) 

1 -sided  s-confidence  intervals  are  analogous  to 
Eq.  2-30;  i.e.,  ignore  Xy  and  use  Eq.  2-30c 
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with  C’  -*■  C,  or  ignore  and  use  Eq.  2-30b 
with  C’  C.  Table  2-8  can  also  be  used  to 
find  and  Example  No.  6 illustrates 
the  procedure. 

The  use  of  other  tables  is  shown  in  Part 
Six,  Mathematical  Appendix  and  Glossary. 
Several  of  the  tables  are  more  convenient 
to  use.  The  ratio  cf  X/X  depends  only  on 
kg , the  failure  at  which  the  test  is  stopped. 

It  is  very  difficult  to  estimate  X closely  when 
there  are  few  failures;  see  Table  2-8  for 
specific  information. 

In  life  tests,  the  total  operating  time  of 
all  units  (regardless  of  how  obtained)  is  used 
in  Bq.  2-29.  It  makes  no  difference  what 
kind  of  censoring  is  used  (if  any)  or  whether 
failed  items  are  replaced,  or  whether  failed 
units  are  repaired.  The  only  requirements 
are  that  X be  a constant,  i.e.,  the  process  is 
Poisson,  and  that  the  number  of  failures  is 
not  a random  variable.  This  situation  is 
related  to  par.  2-3.2  on  the  Poisson  process; 
that  paragraph  is  used  when  the  time  is  fixed 
and  the  number  of  failures  is  the  random 
variable.  Example  No.  7 illustrates  the  pro- 
cedure. 


Table  2-8  can  be  used  in  reverse  to  find 
how  many  failures  must  be  observed  for  a 
given  “accuracy”  in  estimation.  For  example, 
if  a 90%  symmetrical  s-confidence  level  is 
reasonable  (959?r5%),  then  to  get  a ratio  of 
of  about  2 will  require  about  25-30 
failures. 

Reliability  estimates.  One ’of  the  desirable 
properties  of  maximum  likelihood  estimates 
is  that  they  can  be  used  in  any  function  to 
give  a maximum  likelihood  estimate  of  the 
function.  The  same  is  true  for  s-confidence 
limits  when  there  is  only  one  parameter 
being  estimated  from  the  sample.  Example 
No.  8 illustrates  the  procedure. 

2-3.4  s-NORMAL 

The  continuous  random  variable  a:  is  the 
measure  of  failure  resistance,  e.g.,  time-to- 
failure  or  stress-to-failure.  Occasionally,  the 
physieal  situation  prohibits  negative  values 
of  the  random  variable.  If  the  probability  of 
their  oeeurrence  is  very  small,  the  anomaly  is 
usually  ignored;  if  it  can’t  be  ignored,  consult 
a statistician. 


TABLE  2-8 

S-CONFIDENCE  LIMITS  FOR  POISSON  RATE  PARAMETER  (FAILURE  RATE) 

For  the  stated  sconfidence,  and  given  that  the  test  was  stopped  at  failure  k^,  the  body  of  the  table  gives  the  factors 
for  5%&  95%  and  for  2.5%  & 97.5%  Conf  { A > factor  X X }and  the  ratio  of  the  upper  to  the  symmetrical-lower 
limit. 


ko 

1 

2 

3 

4 

5 

6 

8 

10 

15 

20 

50 

5%s-conf. 

3.0 

2.4 

21 

1.94 

1.83 

1.75 

1.64 

1.57 

1.46 

1.39 

1.24 

95%  sconf. 

0.052 

0.18 

0.27 

0.34 

0.39 

0.44 

0.50 

0.54 

0.62 

0.66 

0.78 

k(j/Xi_ 

58 

13 

7.7 

5.7 

4.6 

4.0 

3.3 

2.9 

2.4 

2.1 

1.60 

2.5%  sconf. 

3.7 

2.8 

2.4 

2.2 

2.0 

1.94 

1.80 

1.71 

1.57 

1.48 

1.30 

97.5%  s-conf. 

0.025 

0.32 

0.2L 

0.27 

0.32 

0.37 

0.43 

0.48 

0.56 

0.61 

0.74 

146 

23 

12 

8.0 

6.3 

5.4 

4.2 

3.6 

2.8 

2.4 

1.75 

Example.  If  the  test  is  run  until  the  second  failure,  2.4X  in  5%  of  the  experiments  andX  > 0.18X  in  95%  of  the 
experiments;  the  ratio  of  the  upperto  the  lower  limit  is  33.  i.e.,  the  true  X is  uncertain  to  within  a factor  of  13, at 
the  net  sconfidence  level  of  9Q%. 
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Example  No.  6 


Suppose  that  the  total  operating  time  up  to  the  4th  failure  was  2024  hr.  Estimate 
A,  6,  and  find  a suitable  s-confidence  statement.  Assume  a Poisson  process. 


-Erocedure 

.Example 

i 

State  the  test  results. 

1. 

=4,  U = 2024  hr. 

i 

2. 

Find  a good  point  estimate 

2. 

0 =2024  hr/4  = 506  hr. 

for  A,  6. 

A = 1/0  = 1/506-hr  = 1.  98/lOOO-hr. 

State  the  degrees-of-free- 
dom  V for-the  chi-square 
distribution. 

V = 2k(j  ~ 8. 

3. 

Choose  a s-confidence 

3. 

C =,90%  is  reasonable;  the  choice  is  very  sub' 

level. 

j eetive. 

C'  = 95%,  1 - C'  = 5%. 

4. 

Find  the  values  of  Xp,v 

4. 

Use  Table  2-7, 

! 

xi%, 8 =2.7.33,  forEq.  2-30c 
= 15.51,  for  Eq.  2-30b. 

5. 

Find  the  corresponding 
and  A(7,  the  lower  and  upper 
s-confidence  limits  for  A. 

5. 

= tx|%,8/(2feo)l^  = 0.68/1000-hr 
Xu  = (15.5l/8)(1.98/l000-hr)  =3.  8/lOOO-hr. 

6. 

a 

Make  the  s-confidence 
statement . 

6. 

Conf  {0.  68/1000-hr  ^ X ^ 3,  8/'l000-hr}  = 90%. 

7. 

Use  Table  2-8  to  check  the 

7. 

Aj.  = 0. 34A  = 0.  67/1000-hr 

results. 

Ay  = I.  94A  = 3.  8/1000-hr 
=5.7. 

The  results  are  within  rounding  errors  of 
step  5. 
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Example  No.  7 

A helicopter  inertial  navigation  system  is  tested  (Ref.  ll)and  truncated  at  4 
failures,  at  which  time  1500  hr  of  test  time  have  elapsed.  Estimate  the  mean  life, 
the  2-sided  (symmetrical)  upper  and  lower  s-confidence  limits,  and  the  1-sided  lower 
s- confidence  limit  on  mean  life  for  a s-confidence  level  of  0.95. 


Procedure 


Example 


1.  Tabulate  the  test  results. 


2.  Compute  the  estimated 
mean  life  from  0 = t/k(, 

(2-29) 

3.  Calculate  the  symmetri- 
cal levels. 

4.  Copy  the  appropriate  data 
from  Table  2-8. 


5.  Compute  s-confidence 
limits  for  95%  symmetric 
levels. 


6.  Compute  the  1-sided  95% 
s-confidence  limit. 


7.  Make  the  s-confidence 
statements. 


1.  t =time  elapsed  at  thefeo“f^^  failure  = 1500  hr 
Aq  = number  of  failures  = 4. 

2.  8 = 1500  hr/4  = 375  hr 
X =1/6  =2.67/l000-hr. 


3.  C = 95% 

C'  =97.5%,  1-  C'  =2.5%. 


4.  Ratio  X/X 
2.2 
0.27 
1.94 


s-confidence 

2.5% 

97.5% 

5% 


5.  A = 2,2X  = 2.2  X 2.67/1000-hr  =5.87/l000-hr 
= 1/Xy  = 1 70  h r 

Xi  = 0. 27X  = 0.27  X 2.  67/lOOO-hr 
= 0.72/l000-hr 


= 1/Xi  = 1390  hr. 


6.  Xy  = I.  94X  = 1.94  X 2.67/1000-hr 
= 5.18/l000-hr 

6^  = l/X(y  = 193  hr. 


7.  Conf{l70  hr  8 < 1390  hr}  = 95% 
Conf(193  hr  8}  = 95%. 
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Example  No.  8 


Same  data  as  Example  No.  1,  but  find  the  eorresponding  estimates  for  s-relia- 
bility  with  a mission  time  cf  50  hr. 


Proeedure 


Example 


1.  State  X and  s-eonfidenee 
limits  for  A 


2.  Calculated.  (Eq.  2-27b) 


1.  X =2.67/l000-hr 

Conf  p.  72/1000-hr  87/lOOO-hr}  = 95% 

Conf{ft  ^5.18/l000-hr[  = 95%. 

2.  d = exp(—  M) 

= exp[-(2.67/l000-hr)  x 50  hr] 

= 0.875 


3.  Caleulate  95%  (symmetri- 
cal) s- confidence  limits 
for/?. 


3.  Ru  = exp(-  x^f) 

= exp[-(0. 72/1000-hr)  x 50  hr] 
= 0.965 

= exp(-  Xjft) 

= exp[-(5. 87/1000-hr)  x 50  hr] 
= 0.746 

Conf{0. 746  £R  ^ 0.  965}  = 95%. 


4.  Calculate  the  95%  lower 
1- sided  b'mit  for  R. 


4.  /?  = exp('^  Xjjt) 

= exp[— (5. 18/1000-hr)  x 50  hr] 
= 0.772 

Conf{R  ^ 0.772)  = 95%. 
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Use  the  following  notation: 

H = mean  (location  parameter) 

0 = standard  deviation  (scale  parameter) 

V - random  variable 
N = sample  size 

Xj  = value  of  x for  item  i in  sample 
The  pdf  and  Cdf  are 

pdfw ; K . [-  i(^)  ] 

(2-31a) 

Cdf  {x  gaufi^--"-^  (2-31b) 

The  usual  statistical  problem  is  to  estimate 
p and  a from  a sample. 

It  is  convenient  to  classify  experiments 
according  to  whether  or  not  the  complete 
sample  was  failed. 

2-3.4. 1 All  Items  Teated  to  Failure 

The  maximum  likelihood,  unbiased  esti- 
mate A of  ju  is 

AT 

fx  - sample  mean  = x = il/N)  T/Xi 

i=l 

(2-32) 

The  sample  median  is  also  a very  good  esti- 
mate of  p. 


is  the  maximum  likelihood  estimate  for 
. The  unbiased  estimate  s'^  for  the  vari- 
ance is 

The  s-statistic  in  Eq.  2-34  is  also  very  useful 
in  many  statistical  tests  involving  the  s-normal 
distribution;  s is  NOT  an  unbiased  estimator 
for  a.  The  good  reason  5 is  used  so  much, 
rather  than  a,  is  that  the  sampling  distribu- 
tion of  s is  known  well,  whereas  that  of  d 
is  not. 

The  Cdf  of  x is 

Cdf{x-,  A , o}  = (2-35) 

The  Cdf  of  s is 

Cdf[s;  P ,o}  = csqf  ;N  — 1 

(2-36) 

Eq.  2-35  is  not  feasible  to  use  because  a is 
not  known.  The  Student  t-distribmi.->n  is 
used  instead  (see  Ref  30). 

f - has  the  Student  t-distribution 

with  TV  — 1 degrees  of  freedom 

(2-37) 

Example  No.  9 illustrates  the  application 
of  the  Student  t-distribution. 

2-3. 4.2  Censored  Samples 


The  maximum  likelihood  estimate  for  the 
standard  deviation  is  the  sample  standard 
deviation. 


(7  = 


r T N - 1/2 

^ S (Xi  - x)2 

La'  i=i 


(2-33) 


The  simple  approach  in  par.  2-3.4.1  cannot 
be  used  for  censored  samples.  Maximum 
likelihood  methods  are  most  usual  for  esti- 
mation in  this  case  and  can  give  an  idea  of 
the  uncertainties  involved.  Part  Six  or  Ref 
13  or  a programmer/statistician  ought  to  be 
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Example  No.  9 

For  Data  Set  A (Table  2-3)  find  the  sample  mean  and  sample  standard  deviation. 
Estimate  and  u,  and  find  suitable  s-confidence  limits  for  each. 


Procedure 


Example 


1.  Calculate  the  sample  mean  by  Eq. 
2-32.  Estimate /J. 


1.  x=  1950.7  hr 
At  = 1951  hr. 


2,  Calculate  the  sample  standard  de- 
viation by  Eq.  2-33. 

3.  Calculate  s by  Eq.  2-34. 


2.  CT  = 859.0  hr. 


3. 


s 


= 881.3  hr. 


4.  Find  the  90%,  2-sided  (symmetric) 
s-confidence  limits  for  At.  Use 
Eq.  2-37  and  the  t tables  in  Part 
Six  or  in  Ref  30  or  elsewhere. 

Aty,  At  ^arethe  upper  and  lower 
limits  for  At  . 


4.  f =±  1.729  for  95%,  and  5%  and  19  de- 
grees of  freedom. 


± 1.729  = 


X - U 1950.7  hr  - At 
s/V^  ~ 881.3/V2F 


(881  3 

X 1.729  +1950.7)  hr 

= (340.7  +1950.7)hr 
« 2290  hr 

Ati  ± (-  1.729)  +1950. 7]  hr 

= (-  340.7  +1950.7)hr 
« 1610  hr. 


5.  Compare  with  the  result  cf  the 
graphical  analysis  in  par.  2-2.3 
Example  No.  1(A)  step  3.  They 
are  reasonably  close. 


5.  Graphical  estimation: 
1400  hr  ^At  ^ 2440  hr, 
At  = 1920  hr. 


Analytic  estimation: 

Conf{l610  hr  s At  ^ 2290  hr}  = 90% 
(X  = 1951  hr. 
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Example  No.  9 (Contfd) 


6.  Find  the  90%2-sided  (symmetric) 
s-confidence  limits  for  a.  Use 
Eq.  2-36  and  chi-square  tables  in 
Part  Six  or  Ref.  30,  or  elsewhere. 


7.  Compare  with  the  result  cf  the 
graphical  analysis  in  par.  2-2.3, 
Example  No.  1(A)  step  4.  The 
point  estimates  are  close  enough. 


6.  csqfilO.  1;  19)  = 5% 
csqfiSO.  1;  19)  = 95% 

(from  the  tables) 

(N  - l)s^  _ ort  1 _ 19  ± (881.3  hr)^ 

n n 

0£  = 700.2  hr 

qv  - l)s^  - in  1 - 19 X (881.3  hr)^ 

(Tif  = 1208.0  hr. 

7.  Graphical  estimation: 

290  hr  ^ CT  s 2960  hr 
a = 810  hr. 


Analytic  estimation: 

Conf{700  1210  hr}  = 90% 

a 860  hr. 
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consulted.  Many  statistical  packages  for 
computers  have  prepared  programs  for  mak- 
ing this  calculation. 

2-3.4.3  s-Confidence  Limits  for  s-Reiiability 

Because  two  parameters  (instead  of  one) 
have  been  estimated  from  the  data,  s-eon- 
fidence  limits  are  virtually  impossible  to 
calculate  for  the  s-reliability.  A statistieian 
ought  to  be  eonsulted  in  this  ease.  Perhaps 
Prediction  Intervals  or  Toleranee  Intervals 
can  be  used. 

2-3.5  WEiBULL 

The  eontinuous  random  variable  t is  the 
measure  of  failure  resistance,  e.g.,  time-to- 
failure  or  stress-to-failure. 

Use  the  following  notation: 

t = random  variable  (e.g.,  time  to  failure) 

a = scale  parameter  (characteristic  value) 

& = shape  parameter 

The  Sf  is 

weifc{t/x;  0)  = Sf  {f ; a,  ^3} 

= exp  [-  (f/a)®]  (2-38) 

The  mean  and  variance  are 

E {f}  = aPd  + l/j3)  (2-39a) 

Var{f}=  +2/^) 

- [r(l  + l/i3)]^}  (2-39b) 

The  usual  statistical  problem  is  to  estimate 
a and  |3  from  a sample.  Unfortunately,  there 
are  no  good,  simple  estimators  for  a,^.  See 
Ref.  15  or  Part  Six  or  a statistician/pro- 
grammer. Maximum  likelihood  methods 
often  are  used  because  they  allow  most  any 


kind  of  censoring,  and  provide  a measure  of 
the  uncertainties  and  correlations  in  the 
estimates  of  a and  |3. 

2-3.6  LOGNORMAL 

The  continuous  random  variable  t is  the 
measure  of  failure  resistance,  e.g.,  time  to 
failure  or  stress-to-failure. 

Use  the  following  notation: 

t = random  variable  (e.g.,  time  to  failure) 

CY  = scale  parameter  (median) 

|3  = shape  parameter 

= mean  of  In  t 

a = standard  deviation  of  In  t 
B = exp  [1/(2^")] 

The  Cdf  is 

Cdf{t;a,^}  = gauf  [In  (f/a)®]  (2-40) 

The  mean  and  variance  are 

E {t}  = otB  (2-41a) 

Var{f}  = - 1)  (2-41b) 

The  usual  statistical  problem  is  to  estimate 
a and  ^ from  a sample.  Probably  the  sim- 
plest procedure  is  to  take  natural  logs  of  all 
the  data  and  to  proceed  as  if  the  distribution 
were  s-nonnal.  The  unbiased  property  of 
the  estimators  will  disappear,  but  the  maxi- 
mum likelihood  property  and  s-confidence 
limit  transferance  remain. 

O'  = exp  (n)  (2 -42a) 

(3  = 1/a  (i-42ii 

See  par.  2-3.4  for  the  s-normal  distribution. 
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2-4  GOODNESSOF-FIT  TESTS 

A most  important  consideration  is  why 
the  test  is  being  performed;  see  par.  2-1  for 
a full  discussion  of  this  point.  The  two 
goodness-of-fit  tests  described  in  this  para- 
graph make  a null  hypothesis,  i.e.,  the  sam- 
ple is  from  the  assumed  distribution.  Then 
a statistic,  evaluated  from  the  sample  data, 
is  calculated  and  looked-up  in  a table  that 
shows  how  lucky/unlucky  you  were  for  that 
sample.  The  luek  is  determined  by  the  size 
of  the  2-sided  tail  area.  If  that  tail  area  is 
very  small  (you  were  very  unlueky  if  the 
null  hypothesis  is  true),  the  null  hypothesis 
(there  is  no  differenee  between  the  aetual 
and  the  assumed  distributions)  is  rejected. 
Otherwise,  the  null  hypothesis  is  aecepted, 
i.e.,  the  aetual  distribution  could  easily  have 
generated  that  set  of  data  (within  the  range 
of  the  data);  the  test  says  nothing  about  the 
behavior  of  the  distribution  outside  the 
range  of  the  data. 

There  are  many  goodness-of-fit  tests 
(Refs.  3,  4,  6,  7,  24,  and  25).  The  two  pre- 
sented in  this  paragraph  are  all-purpose  (do 
not  depend  very  much  on  which  distribu- 
tion is  assumed)  and  are  reasonably  good. 
The  chi-square  test  ought  not  be  used  for 
toosmall  samples  (say,  less  than  30)  be- 
cause the  assumptions  involved  are  not 
likely  to  be  fulfilled. 

Ref  24  (Chap.  30)  and  Ref  25  diseuss 
both  tests.  In  practice,  many  of  the  impor- 
tant requirements  are  not  fulfilled  beeause 
too  mueh  cf  the  analysis  is  deeided  after 
seeing  the  data.  But  if  the  test  is  used  for 
“ballpark”  eonfirmation,  little  harm  is  done. 

Tests-of-fit  are  statistical  tests,  not  engi- 
neering tests.  No  matter  what  the  distri- 
bution or  what  the  test,  it  is  possible  to 
take  a sample  small  enough  so  that  virtually 
no  distribution  will  be  rejected,  or  large 
enough  so  that  virtually  every  distribution 
will  be  rejected. 

Tests-of-fit  do  NOT  determine  how  well 


the  proposed  distribution  will  fit  the  actual 
one  in  the  regions  where  there  are  no  data. 

It  is  poor  practice  to  find  the  “best”  dis- 
tribution by  choosing  the  one  which  fits 
the  sample  best.  The  examples  in  Figs. 

2-10  and  2-1 1 ought  to  dispell  that  notion 
once  and  for  all. 

2-4.1  CHI-SQUARE  TEST 

The  chi-square  test  is  performed  by  di- 
viding the  data  from  the  sample  into  cells. 
The  actual  number  of  data  points  in  each 
cell  is  compared  to  the  predicted  number 
for  that  cell  and  a combined  statistic  X'^  is 
calculated  for  all  cells;  it  is  then  compared 
with  Xj/. 

= h .S  ~ (2-43) 

<=1 

where 

x]f  - a random  variable  having  the 
chi-square  distribution  with  v 
degrees  of  freedom 

«o  = observ'ed  number  in  each  cell 

rig  = expected  number  in  each  cell 

k = number  of  cells 

V = k — \ \i  none  of  the  parameters 
of  the  distribution  is  estimated 
from  the  data.  If  5 parameters 
are  estimated  from  the  data, 
thenk-  \ > v > k - 1-5. 

The  exact  value  of  v depends 
on  how  the  parameter  estimates 
were  made. 

If  Tig  is  the  same  for  each  cell  (equal  pro- 
bability method  of  ehoosing  cells),  then 
rig  = N/k  and 

= 0 S Wo)  - N (2-44) 

where  N = number  in  sample. 
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A heuristic  (and  rigorously  erroneous,  but 
very  useful)  description  of  the  source  of  the 
statistic  is  helpful  (see  Ref  24,  Chapter  30 
for  detailed  derivations). 

The  number  in  each  cell  has  a binomial 
distribution,  which  depends  on  2 param- 
eters: the  total  number  in  the  sample,  and 
the  probability  of  a value  falling  in  that 
cell.  As  the  s-expected  number  in  the  cell 
becomes  very  large,  the  binomial  distribu- 
tion turns  into  a s-normal  distribution  with 
the  same  mean  and  a standard  deviation 
equal  to  the  square  root  of  the  mean  y/nj- 
The  number  in  each  cell  is  converted  to  a 
standard  s-normal  variate  by  subtracting  the 
mean  and  dividing  by  the  standard  devia- 
tion. The  sum  of  the  squares  of  such  vari- 
ates has  a chi-square  distribution  with  k — \ 
degrees  of  freedom;  each  term  is  of  the 
form 


(2-45) 


The  1 degree  of  freedom  is  lost  because  the 
last  variate  is  not  s-independent,  i.e.,  it  can 
be  calculated  from  the  previous  data  be- 
cause the  total  number  in  the  sample  is 

known. 

Conventionally,  only  a I-tail  test  is  used, 
i.e.,  the  calculated  value  of  ought  not 
be  too  large.  But  one  ought  to  be  equally 
suspicious  of  too-small  values;  if  the  usual 
variability  is  not  there,  someone  may  have 
tampered  with  the  data.  Conventional  wis- 
dom suggests  that  there  ought  to  be  at 
least  5 data  points  in  each  cell  and  at  least 
30  total  data  points.  But  the  usual  engi- 
neer will  do  the  best  he  can  with  the  data 
he  has. 

If  the  calculated  value  of  is  greater 
than  the  tabulated  value  for  (at  a 
particular  s-significance  level)  reject  the 
assumed  distribution. 


A table  of  values  is  given  in  Table 
2-9;  other  tables  are  given  in  Ref  30. 

Example  No.  1 0 illustrates  the  applica- 
tion of  the  Weibull  distribution. 

2-4.2  THE  KOLMOGOROV-SMIRNOV 
(K-S)  TEST 

The  Kolmogorov-Smimov  test  is  another 
analytic  procedure  for  testing  goodness-of- 
fit.  The  procedure  compares  the  observed 
distribution  with  a completely-specified 
hypothesized-distribution  and  finds  the 
maximum  deviation  between  the  Cdfs  for 
the  two.  This  deviation  is  then  compared 
with  a critical  value  that  depends  on  a pre- 
selected level  of  s-confidence  (Refs.  7,  19, 
24,  and  25);  see  Table  2-12. 

The  Kolmogorov-Smirnov  test  is  distribu- 
tion-free; it  can  be  used  regardless  of  the 
failure  distribution  that  the  data  are  assum- 
ed to  follow,  provided  the  random  variable 
is  continuous.  The  discriminating  ability  of 
the  test  depends  on  the  sample  size;  larger 
sizes  discriminate  better.  If  the  random 
variable  is  discrete,  the  s-confidence  level 
will  be  greater  than  that  shown  in  Table 
2-12  (Ref  24). 

The  test  is  good  regardless  of  sample  size. 
Most  discussions  of  the  discriminating  ability 
of  the  test  are  from  a statistical  rather  than 
an  engineering  viewpoint. 

The  steps  in  a Kolmogorov-Smimov  test 
are  as  follows. 

1.  Completely  specify  the  hypothetical 
distribution  to  be  tested,  (x).  If  it 
has  several  parameters,  a value  for  each  of 
those  parameters  must  be  specified.  If  any 
of  the  parameters  were  estimated  from  the 
data,  step  4 must  be  modified  as  specified 
in  step  4. 

2.  At  each  sample  point  x,  ; 

[text  continues  on  page  2-69] 
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COMPLEMENT  OF  Cdf  OF  X*  (Adapted  from  Ref.  3) 
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Example  No.  10 


A group  of  50  relays  is  life  tested  (Ref.  4). 
given  in  Table  2-10. 


TABLE  2-10 


The  numbers  cf  cycles  to  failure  are 


CYCLES  TO  FAILURE 


00 

10 

20 

30 

40 

1283 

4865 

8185 

13167 

28946 

1887 

5147 

8559 

14833 

29254 

1888 

5350 

8843 

14840 

30822 

2357 

5353 

9305 

14988 

38319 

3437 

5410 

9460 

16306 

41554 

3606 

5536 

9595 

17621 

42870 

3752 

6499 

10247 

17807 

62690 

3914 

6820 

11492 

20747 

63910 

4394 

7733 

12937 

21990 

68888 

4398 

8025 

12956 

23449 

73473 

Because  it  often  is  assumed  that  relay  life  data  have  a Weibull  distribution,  we  will 
estimate  the  parameters  of  the  Weibull  distribution  which  fit  the  data;  then  we  will 
test  the  hypothesis  that  the  data  came  from  that  exact  distribution. 

Procedure  Example 


1.  Estimate  the  parameters  by  a graph- 
ical method  (details  not  given  here) 
c = cycles-to-failure.  (Eq.  2-38) 


2.  State  the  number  of  points.  Choose 
the  number  cf  cells  A.  There  are  50 
points,  and  it  is  nice  to  have  an  s- 
expected  number  of  points  in  each 
cell  cf  5 or  more. 

3.  Calculate  the  cell  boundaries.  Use 
the  “equal  probability”  method  be- 
cause it  is  handy,  and  does  not  de- 
pend on  the  data.  The  range  of  0-1 
for  S/  is  divided  into):  equal  parts. 


1.  S/{c}  = weifc  ica^p)  = exp[-(c/a)®] 

P = 1.2 

O'  = 16. 6 X 10®  cycles 
N = 50. 

2.  A =50/5  = 10. 


3.  The  Sf  cell  boundaries  are  * ^ f|i . 

i = 0,  1,  2,.  . . , 10:  0.0,  0.1,  0.2, 
0.3,...,  0.9,  1.0. 
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Example  No.  10  (Cont'dl 

4.  Calculate  the  values  of  c which  form  4.  See  Table  2-11  for  results, 
the  boundaries 


c = 16. 6k  ~^-|^^(the  inverse  of 
Eq.  2-38), 

From  the  data  find  how  many  are  in 
each  cell.  The  is  5,  because  the 
(AS/)  X 50  = 5. 

5.  Find  v.  Use  Eq.  2-44  for 
k - 1 5:  y > k^~  s - 1.  2 param- 
eters (a  and  were  determined. 


6.  Find  csqf(X^,v)  from  Table  2-11. 
Numbers  very  near  one  cause  the 
null  hypothesis  to  be  rejected. 


7.  Is  the  result  s-significant;  i.  e.  , 
how  unlucky  were  we? 


5.  X^  =9.20  for  the  sample  (same  answer 
as  in  Table  2-11). 

s =2,  k =10 

9 ^ V ^ 7. 

6.  cs^/(9.20;  0)  « 0.58 

csqfiO.  20;7)  « 0.75 

Thus,  values  ofX^  would,  by  chance 
alone,  be  bigger  than  9.2  about  25%  to 
40%  of  the  time. 

7.  Our  value  of  9.2  is  reasonable  and  we 
do  not  reject  the  null  hypothesis  that 
“the  lives  in  Table  2-10  are  from  the 
Weibull  distribution  calculated  in  step 
1.”  The  results  are  not  s-significant 
even  at  the  20%  level. 
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TABLE  2-11 

CALCULATIONS  FOR  RELAY  FAILURE  PROBLEM 
Cell  Boundaries  Number  in  Cell 

Observed  Expected  


Sf 

C (/f-cydes) 

'’o 

1.0 

0.0 

1 

5 

3.20 

0.9 

1.46 

3 

5 

0.80 

0.8 

3.09 

7 

5 

0.80 

0.7 

4.93 

7 

5 

0.80 

0.6 

7.07 

7 

5 

0.80 

0.5 

9.59 

3 

5 

0.80 

0.4 

12.68 

7 

5 

0.80 

0.3 

16.65 

4 

5 

0.20 

0.2 

22.26 

4 

5 

0.20 

Q1 

31.85 

7 

5 

0.80 

0 

OO 

- 

- 

- 

50 

50 

9.20 

a Compute  the  hypothetical  Cdf  as 

^hyp 


plicated  to  find  the  fraction  of  occasions  the 
correct  decision  will  be  made. 

In  many  cases,  the  parameters  of  the  hypo- 
thetical Cdf  will  be  estimated  from  the  sample 
(test)  data.  Under  these  circumstances  the 
critical  d-values  in  Table  2-12  are  too  large  and 
will  lead  to  higher  s-confidence  levels  than 
anticipated  (higher  than  specified  in  the  table). 
Results  of  Monte  Carlo  in\  estigations  have 
shown  that  the  following  rule-of-thumb  adjust- 
ments to  Table  2-12  can  be  made  to  yield  good 
critical  values  for  the  s-normal  and  exponential 
distributions  (Ref.  3). 

5.  In  step  4 when  estimating  mean  and 
standard  deviation  of  a s-normal  distribution 
from  the  test  data,  multiply  the  value  of  d 
from  Table  2-12  by  0.67.  When  estimating 
the  mean  life  for  an  exponential  distribution, 
multiply  the  value  of  d from  Table  2-12  by 
0.80. 

Another  w ay  of  using  the  Kolmogorov- 


b.  Compute  the  sample  Cdf  as  = 

r/N  and  as  — 1 )/N,  where  N is 

the  sample  size,  and  y is  the  order  number 
of  the  sample  point. 

c.  Calculate  d,,  the  absolute  value  of 
the  maximum  difference  between  the 
sample  and  hypothetical  Cdfs.  Do  this  by 
finding  |F^^p  (x,)  - F^,- 1 and  |F;,^p  (x^)  - 
F^  I;  the  larger  one  is  d,. 

3.  Find  , the  largest  d,  (over  all  y) 
in  step  2c. 

4.  Find  the  critical  value  d from  Table 
2-12  for  the  sample  size  and  the  selected 
s-confidence  level.  < d,  accept  the 

hypothesis  that  the  observed  sample  could 
have  come  from  the  hypothetical  distribution 
Ffjyp  (x);  otherwise,  reject  the  hypothesis.  If 
the  s-confidence  level  is  C,  the  correct  decision 
will  have  been  made  on  the  fraction  C of  the 
occasions  the  test  is  used  when  the  hypothesis 
is  true.  If  the  hypothesis  is  not  true,  it  is  com- 


TABLE  2-12 

CRITICAL  VALUES  d OF  THE  MAXIMUM 
ABSOLUTE  DIFFERENCE  BETWEEN  SAMPLE 
AND  POPULATION  FUNCTIONS  FOR  THE 
2-SIDED  K-S  TEST 
(ADAPTED  FROM  REF.  3) 

Sample  s-Confidence  Level 

Size 


N 

00% 

05% 

90% 

95% 

99% 

4 

0.49 

0.52 

0.56 

0.62 

0.73 

5 

0.45 

0.47 

o.a 

0.56 

0.67 

10 

0.32 

a34 

0.37 

0.41 

0.49 

15 

0.27 

0.28 

0.30 

0.34 

0.40 

20 

0.23 

0.25 

0.26 

0.29 

0.36 

25 

0.21 

0.22 

0.24 

0.27 

0.32 

30 

0.19 

0.20 

0.22 

0.24 

0.29 

35 

O.IS 

0.19 

0.20 

0.23 

0.27 

40 

0.17 

0.18 

0.19 

0.21 

0.25 

50 

0.15 

0.16 

0.17 

0.19 

0.23 

N>  10 

1.07 

1.14 

1.22 

1.36 

1.63 

V5v+j 

\/nT\ 

V?v+j 

y/fM 
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Smirnov  test  is  to  find  the  critical  value  of 
d from  T able  2-1 2 first.  Then  add  it  to  and 
subtract  it  from  the  sample  Cdf  (the  and 
in  step  2b).  This  gives  a band  within 
which  the  hypothetical  distribution  will  lie 
(at  the  stated  s-confidence  level).  This  is  a 
very  good  approach,  especially  when  the 
sample  is  plotted  on  special  graph  paper  for 
which  the  hypothetical  distribution  will  be 
a straight  line.  It  is  explained  more  fully  in 
par.  2-5. 


The  procedure  is  illustrated  in  Fig.  2-1 2(A) 
where  the  sample  data  from  Table  2-1 3 are 
plotted.  The  line  S is  the  result  of  plotting 
Fjy,and  F^  from  step  2b.  Lines  U and  L are 
obtained  by  adding  d to  and  subtracting  d 
from  line  S,  respectively;  d = 29%from  Table 
2-12  for  A = 20  and  s-confidence  = 95%. 

The  true  distribution  (uniform  over  zero  to 
one)  is  the  45-deg  line  from  the  origin  to  the 
point  (1,1 00%);it  lies  well  within  the  s-con- 
fidence  band  bounded  by  the  lines  U and  L. 


Random  Variable  X 

Figure  2- 12  (A).  Kolmogorov-Smirnov Limits  (95%s-Confidence  and  Sampie 

Cdf -from  Table  2- 13) 
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TABLE  2-13 

RANDOM  SAMPLE  FROM  THE  UNIFORM  DISTRIBUTION 

These  numbers  were  taken  from  a table  of  pseudo-random  numbers  which 
were  uniformly  distributed  between  O.CX)  and  1.00.  They  have  been  ordered 
from  smallest  to  largest.  N (samplesize)  = 20;  /■  is  the  order  number;  x is  the 
random  variable. 


r 

X 

r 

X 

r 

X 

r 

X 

1 

0.01 

6 

0.24 

11 

0.57 

16 

0.84 

2 

0.02 

7 

0.48 

12 

0.65 

17 

0.86 

3 

0.03 

8 

0.48 

13 

0.7  0 

18- 

0.87 

4 

0.08 

g 

0.52 

14 

0.75 

19 

0.88 

5 

0.23 

10 

0.57 

15 

0.79 

20 

0.99 

The  sample  Cdf  and  the  95% s-confidence  limits  (seeTable  2-12)  are  plotted 
in  Fig.  2-1 2(A).  Each  point  in  the  table  is  plotted  at  (r-^)/N  and  at  r/N  for 
the  sample  Cdf. 


It  is  easy  to  see  that  the  sample  could  easily 
have  come  from  many  other  distributions, 
i.e.,  any  that  lie  between  lines  U and  L. 

In  practice,  plotting  the  graphs  will  be  in- 
accurate and/or  tedious  for  > 10,  say. 
Therefore,  the  shortcut  analytic  method  (des- 
cribed in  the  next  paragraph)  ought  to  be 
used.  It  is  based  on  the  fact  that,  even  at 
poor  (low)  levels  of  s-confidence  the  critical 
value  of  d is  large  compared  to  l/N  (1/A/  is 
the  increase  in  the  sample  Cdf  at  each  sample 
point).  At  each  “evaluated  sample-point”  it 
is  reasonably  easy  to  calculate  the  smallest 
subsequent  sample-point  which  could  pos- 
sibly cause  rejection  of  the  hypothetical  dis- 
tribution. 

Fig.  2-1 2(B)  shows  how  this  exercise  is 
done.  Suppose  the  sample-point  number  i = 

/„  has  been  evaluated  and  is  within  the  lines 
U and  L as  described  in  Fig.  2-1 2(A).  Fig. 

2-1 2(B)  is  a small  portion  of  a typical  sample 
Cdf  plot  with  the  K-S  lines  U and  L shown 
on  it.  Tj^yp  (x)  can  be  rejected  only  if  it 
crosses  lines  U or  L;  we  will  find  the  small- 
est sample-point  for  which  that  can  happen. 


If  Ffiyp  (x)  is  to  be  rejected  by  crossing 
line  L (see  path  A),  the  earliest  it  can  do  so 
is  for  the  smallest  sample-point  number 
for  which 

^ (2—46) 

This  is  so  because  a Cdf  can  never  decrease. 

If  F/,yp  (x)  is  to  be  rejected  by  crossing 
line  U (see  path  B),  the  earliest  it  can  do  so 
is  for  the  smallest  sample-point  number  ig 
for  which 

¥^^{x{^)^(io/N)+d  (2-47) 

This  is  so  because  the  sample  Cdf  increases 
by  1/Al  at  each  sample  point. 

The  next  sample-point  number  is  the 
smaller  of  and  ig.  Example  No.  11  il- 
lustrates the  procedure. 

2-5  KOLMOGOROV-SMIRNOVs-CONF!- 
DENCE  LIMITS 

Chapter  30  of  Ref  24  (and  other  refer- 
ences) shows  that  the  K-S  critical  values  in 
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Sample- point  Numbers 

Figure  2-12fB).  Kolmogorov-Smirnov  Goodness-cf-Fit  Jest,  Shortcut  Calculation 


Table  2-12  can  be  used  to  put  s-confidence 
limits  on  the  actual  Cdf.  The  steps  in  the 
procedure  are: 

1.  Select  the  desired  s-confidence  level 
and  pick  the  value  of  d from  Table  2-12.  It 
will  also  depend  on  the  sample  size  N.  A 
s-confidence  level  of  about  1 — (1/A^)  is  rea- 
sonable. 

2.  At  each  sample-point  number  y: 

a.  Compute  the  sample  Cdf  as: 

I'm  =r/N,  Flo  = (r  - D/JV  (2-48) 


This  is  a pair  of  points  on  line  S;  see  Fig. 
2-12. 

b.  Compute  + d,  and  cl- 

This  is  a pair  of  points  on  line  U,  the  upper 
s-confidence  line;  see  Fig.  2-12. 

c.  Compute  - d,  and  F^  — d. 
This  is  a pair  of  points  on  line  L,  the  lower 
s-confidence  line;  see  Fig.  2-12. 

3.  Connect  all  the  points  on  line  U.  Con- 
nect all  the  points  on  line  L.  Each  pair  of 
points  in  step  2b  or  2c  is  plotted  at  the 
value  of  the  random  variable  at  sample-point 
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Example  No,  11 


Use  the  relay  data  in  Example  No.  10  in  par.  2-4,1.  See  if  they  might  reasonably 
have  come  from  an  exponential  distribution,  i.  e.  , = 1 -exp(— jc/6).  For  sim- 

plicity of  notation,  define 

Procedure  Example 

1.  Calculate  the  sample  1.  Sample  mean  = 16,994  = 6. 

mean. 


2.  Find  the  critical  value  2. 

of  d from  Table  2-12; 

90% s -confidence  seems 
reasonable. 

3.  Since  we  estimated  the  3. 

exponential  parameter 

from  the  data,  multiply 
d by  0,  8. 

4.  Begin  with  lowest  value,  4. 

i = 1.  {F^  denotes  the 

actual  Cdf  at  sample- 
point  i. ) 


5a.  Calculate  and  from  5a. 

Eqs.  2-46  and  2-47. 

Use  the  i to  denote  the 
actual  intersections  in 
Fig.  2-12(B).  They 
will  generally  be  frac- 
tional values. 


b.  Find  the  next  «o  b. 

= min-^'j^^,  ?b};  evaluate 
F Compare  with  ii^/N 
and  with  (?o  — l)/iV. 


ForiV  =50,  and  s- confidence  = 90% we  have 
d = 0.17. 

Newd  =0.17  X 0.8  = 0.14. 


jPi  = 1 “ exp(-  first  failure/sample  mean) 

Fi  = 1-  exp(-  1283/16994)  = 0.073. 

0/50  = 0.00;  1/50  = 0.02. 
di  = 0.073  < 0.14;  OK. 

ffl  = 1 

(t‘/50)  - 0.14  =Fi  = 0.073 
i = 10*,  = 11 

s (1/50)  + 0.14  = 0.16 
Fixi)  = 0-16 

0.16  = 1-  exp(- ;c,/l6994) 

Xi  = 2962,  = 5. 

*0  = min{5, 11}  = 5,  = 3437. 

F,  = 0. 183  (by  same  procedure  as  in  step  4) 

ifi/N  = 5/50  = 0.10;  (*o  - D/N"  = 0.08. 

The  maximum  difference  isds  = 0.103  which 
is  less  than  0.14;  OK 
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Example  No.  11  (Cont'd) 


6a.  Repeat  step  5a  with 
new  t’o.  - 


b.  Repeat  step  5b  with 
new  i(j. 


7a.  Repeat  step  5 with 
new  *0. 


b.  Repeat  step  5b  with 
new  t'o* 


8a.  Repeat  step  5a. 


b.  Repeat  step  5b. 


9a.  Repeat  step  5a, 


b.  Repeat  step  5b. 


6a.  U/50)  -0.14  =F  = 0.183 

i = 16'*’,  tA  “ 1 7 

_ ^ (5/50)  +0.14  = 0.24 

Xf  =4663,  ig  = 11  (by  same  proeedure  as  in 
step  5) 

b.  t’o  = 17}  = ll,a:ii  = 4865 

Fii  = 0.249 

io/N  = 1 1/50  = 0.  22;  (fo  - D/N  = 0. 20. 
dll  = 0-049  <0.14;  OK. 

7a.  (f/50)  - 0.14  =Fii  = 0.249,  i = 19*,  = 20 

F,g  2:  (11/50)  +0.14  = 0.36 
X,  = 7584,  ig  = 19. 

b.  *0  = min{l9,  20}  = 19,  xig  = 8025 
Fig  = 0.376 

to/77  = 19/50  = 0.38;  (t'o  - 1)/N  = 0.36. 
dig  = 0.016  < 0.14;  OK. 

8a.  (t/50)  - 0.14  = Fig  = 0.376,  tA  = 26. 

F(  ^(19/50)  +0.14  = 0.52 
X{  = 12,473,  tg  = 29. 

b.  *0  = 26,  xzs  = 9595 
Fgg  = 0.431 

to/JV  = 26/50  = 0.52;  (to  - 1)/N  = 0.  50. 
dge  = 0.089  < 0.14;  OK. 

9a.  (t'/50)  - 0.14  =Fjg  = 0.431,  tA  = 29 
^ (26/50)  + 0.14  = 0.66 
X,  = 18,333,  tg  = 38. 

b.  t*o  = 29,  X29  = 12,9  3 7 
Fgg  = 0. 533 

to/7/  = 29/50  = 0.58;  (tg  - D/N  = 0.56. 
rfjg  = 0.047  < 0.14;  OK. 


2-74 


AMCP  706-198 


Example  No.  11  (Cont'd) 


10a.  Repeat  step  5a. 


b.  Repeat  step  5b, 


11a.  Repeat  step  5 with 
new  i(j. 


b.  Repeat  step  5b. 


12.  Repeat  step  5. 


13.  Repeat  step  5. 


10a.  (i/50)  - 0.14  =^29  = 0.533,  <a  = 34 
2:  29/50  +0.14  = 0.72 
Xi  = 21,632,  tQ  = 39. 

b.  *0  = 34,  ;c34  = 14,9  8 8 
F34  = 0.586 

io/N  = 34/50  = 0.68;  (*o  - D/N  = 0.66. 
(B4  = 0.094  < 0.14;  OK. 

11a.  (i/50)  - 0.14  =75/ = 0.586,  *^  = 37 
p,  5:  34/50  +0.14  = 0.82 
XTj-29,141;  i,B  = 42 

b.  *0  = 37,  X37  = 17,807 
F37  = 0.649 

37/50  = 0.74;  36/50  = 0.72. 

= 0.091  < 0.14;  OK. 

12.  (i/50)  - 0.14  =/37  = 0.649,  iA  = 40 

s:  37/50  +0.14  = 0.88 
36,031;  *5  = 44 
*0  = 40,  X40  = 23,449 
-P40  = 0.748 

40/50  = 0.80;  39/50  = 0.78. 

^40  = 0.052  < 0.14;  OK. 

13.  (*/50)  - 0. 14  = F40  = 0.  748,  *\  = 45 
F.  ^ 40/50  +0.14  = 0.94 

B 

Xf  = 47,  811;  *B  = 47 
io  = 45,  X45  =41,554 
F45  = 0.913 

47/50  = 0.94;  46/50  = 0.92. 

<i45  = 0.  027  < 0, 14;  OK. 
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Example  No.  11  (Cont'd) 


14,  Repeat  step  5.  14.  (i/50)  — 0.14  =^45  = 0.913,  i'a  > 50 

Fjg  > 45/50  +0.14  = 1.04,  ig  > 50. 

Thus  X50  must  be  OK  and  the  distribution  i 
not  rejected. 

Only  11  trials  (f  = 1,  5,  11,  19,  26,  29,  34,  37,40,  45,  50)  were  necessary  for  the 
50  points.  Interestingly  enough,  we  now  have  two  distributions  to  explain  the  relay 
data  in  par.  2-4. 1.  Unless  there  are  compelling  reasons  to  the  contrary,  one  is 
rightly  tempted  to  pick  the  simpler  distribution. 


2-76 


AMCP  706-198 


number  r.  The  region  between  lines  U and 
L is  the  s-confidence  envelope;  i.e.,  the  true 
Cdf\\QS  entirely  within  the  U,  L-envelope 
with  the  s-confidence  level  chosen  in  step  1. 
The  larger  the  s-confidence  level,  the  wider 
the  envelope  and  the  less  informative  is  the 
conclusion  to  be  drawn. 

If  the  plot  is  made  on  special  graph  paper 
such  that  the  desired  distribution  is  a 
straight  line,  then  a distribution  of  that  form 
is  completely  acceptable  (with  s-confidence 
C)  if  a straight  line  fits  within  the  envelope. 

Of  course,  as  usual,  no  guarantees  are 
made  for  extrapolations  outside  the  range 
of  the  data.  If  extrapolations  are  made,  be 
sure  to  show  the  uncertainty  range  (this  pre- 
sumes that  the  form  of  the  distribution  is 
correct).  The  actual  uncertainty,  which  in- 
cludes doubt  about  the  form  of  the  distri- 
bution, is  usually  much  greater.  But  even 
the  calculated  range  of  statistical  uncertainty 
is  usually  discouraging  enough. 

2-6  NONPARAMETRIC  ESTIMATION 

Nonparametric  methods  can  be  used  to 
estimate  reliability  and  mean  life;  i.e.,  it 
is  not  necessary  to  make  any  assumptions 
concerning  the  time-to-failure  distribution 
(Refs.  3 and  10).  Nonparametric  reliability 
applies  to  the  test  time  interval  only  and 
cannot  be  extrapolated  in  the  time  domain. 
This  is  the  same  as  estimating  a binomial 
parameter.  See  par.  2-3.1  for  more  details. 

If  the  failure  times  are  known,  a nonpara- 
metric s-confidence  limit  for  the  Cdf  can  be 
calculated  as  shown  in  par.  2-5.  See  par. 
2-2.2  when  censoring  occurs.  For  cases 
which  do  not  fit  the  techniques  in  this  hand- 
book, a statistician  ought  to  be  consulted; 
it  is  very  easy  to  go  astray. 

The  simplest  way  to  estimate  the  unreli- 
ability for  a time  interval,  is  to  calculate  the 
proportion  of  items  that  fail  over  that  in- 
terval. 


2-6.1  MOMENTS 

The  mean  and  standard  deviation  of  a 
population  can  be  estimated  by  equating 
them  to  the  sample  mean  and  standard  de- 
viation, respectively.  This  can  be  done 
without  regard  to  the  actual  distribution. 
This  is  the  way  the  parameters  of  the  s- 
normal  and  exponential  distributions  are 
estimated.  Weighted  sample  moments  can 
be  used  if  desired.  For  example,  the 
logarithm  of  the  mean  can  be  estimated  as 
the  mean  of  the  logarithms  of  the  data. 

Each  weighting  will  give  a different  answer, 
but  the  scatter  is  probably  less  than  the  un- 
certainty anyway. 

Since  moments  of  a population  can  de- 
pend very  heavily  on  the  tail  regions  of  the 
distribution,  and  since  very  few  (if  any) 
data  are  collected  there,  it  is  usually  best  to 
use  quantile  estimators.  Quantile  estimators 
are  remarkably  insensitive  to  the  actual  be- 
havior in  tail  regions. 

If  there  are  contractual  obligations  con- 
cerning nonparametric  estimation  of 
moments,  a competent  statistician  ought  to 
be  consulted. 

2-6.2  QUANTILES 

Sample  quantiles  often  are  used  as  esti- 
mates of  population  quantiles.  Population 
quantiles  (and  combinations  thereof)  often 
are  used  to  indicate  population  character- 
istics. For  example,  the  median  is  a good 
measure  of  the  “central  tendency”,  and  the 
distance  between  the  75%  and  25%  points 
is  a good  measure  of  the  dispersion. 

Point  estimates  and  s-confidence  limits 
can  be  obtained  using  the  method  in  par. 
2-5.  Par.  2-2.1  also  contains  material  on 
point  estimates  and  s-confidence  limits. 

If  the  sample  has  been  severely  censored, 
it  may  not  be  feasible  to  use  these  methods. 
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In  this  situation,  a competent  statistician 
ought  to  be  consulted.  One  may  even  wish 
to  consult  the  statistician  before  planning 
the  experiments  or  trying  to  get  historieal 
data. 


2-7  ANALYSIS  OF  VARIANCE 

During  system  design  and  development,  it 
may  be  desirable  to  establish  the  relation- 
ship between  reliability  and  speeifie  environ- 
mental parameters  (Refs.  2 and  6).  Also, 
the  system  designers  may  wish  to  determine 
if  ehanges  in  environmental  faetors  or  com- 
binations of  them  have  ai  important  im- 
paet  on  reliability.  It  is  possible,  by  eareful 
experimental  design,  to  obtain  a eonsiderable 
amount  of  information,  even  with  smaller 
sample  sizes.  Two  teehniqiies  will  be  dis- 
eussed— the  analysis  of  variance  and  regres- 
sion analysis. 

Analysis  of  variance  permits  the  effects  of 
individual  or  combinations  of  several  en- 
vironmental factors  on  reliability  to  be  de- 
termined. By  use  of  regression  analysis,  an 
equation  can  be  derived  which  relates  re- 
liability to  environmental  parameters. 

It  is  very  difficult  to  design  a test  that 
covers  the  entire  range  of  environments  that 
an  equipment  experienees  in  praetiee  (Refs. 

6 and  16).  However,  if  the  most  important 
parameters  can  be  isolated,  a test  ean  be  de- 
signed around  them  alone  with  all  the  other 
parameters  being  ignored.  During  the  test, 
the  test  parameters  are  allowed  to  assume  a 
range  of  values  which  simulate  the  operation- 
al environment  of  the  equipment.  The  be- 
havior of  the  test  units  under  various  eom- 
binations  of  the  test  parameters  is  observ  ed. 
It  is  then  possible  to  use  analysis  of  variance 
to  determine  the  effect  of  each  parameter 
acting  singly  or  in  combination. 

The  ability  to  analyze  the  effects  of  com- 
binations of  parameters  is  a very  useful 
part  of  analysis  of  variance.  A component 


may  be  reliable  at  a certain  level  of  tempera- 
ture. It  may  also  be  reliable  at  a certain 
vibration  level.  However,  a combination  of 
these  same  environmental  levels  may  cause 
serious  degradation  in  reliability.  Analysis  of 
variance  permits  the  effects  of  these  inter- 
actions to  be  evaluated. 

Three  sources  of  variations  in  reliability 
are  considered:  (1)  variations  caused  by 
each  environment  acting  singly,  (2)  vari- 
ations caused  by  combinations  of  environ- 
ments, and  (3)  a remainder  (the  residual 
error)  which  is  caused  by  slight  variations 
in  the  production  processes  and  test  equip- 
ment fluctuations.  The  residual  error  is  used 
as  a standard  against  which  the  other  sources 
of  variability  are  compared  to  determine 
their  statistical  significance. 

2-7.1  STATISTICAL  EXPLANATIONS 

Just  as  the  name  implies.  Analysis  of 
Variance  (ANOVA)  analyzes  the  variances  of 
a set  of  data  to  see  if  some  effects  are  real, 
or  just  due  to  random  sampling  effects. 

Three  categories  for  measurements  are  in- 
volved: 

1.  Factors  (e.g.,  heat  treatment,  supply 
voltage,  humidity) 

2.  Levels  within  a factor  (e.g.,  high 
voltage,  usual  voltage,  low  voltage) 

3.  Replication  within  levels  (e.g.,  10 
measurements  for  each  voltage). 

Eaeh  measurement  is  of  a performance  char- 
aeteristic  such  as  strength  or  time-to-failure. 

Just  to  get  a broad  picture  of  what  is  in- 
volved, consider  the  following  experiment  on 
some  radio  receivers.  The  time-to-first- 
failure  is  to  be  measured  for  each  receiver. 

1.  Factors.  There  are  2 factors: 
a.  Ambient  temperature 


o 

a 
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b.  Supply  voltage 

2.  Levels.  There  are  2 levels  of  ambient 
temperature: 

a. 

b.  Usual 

and  3 levels  of  supply  voltage 

a.  High 

b.  Usual 

c.  Low 

3.  Replication.  There  are  4 receivers 
operated  at  each  possible  condition. 

Table  2-14  shows  the  measurements  which 
will  be  made.  This  is  called  a full-factorial 
experiment  since  all  possible  combinations  cf 
levels  and  factors  occur.  Full-factorial  ex- 
periments are  often  too  expensive  and  time 
consuming  to  run.  Suppose  that: 

1.  The  average  life  of  a receiver  under 
the  experimental  conditions  is  3 months. 

2.  There  are  6 test  stands,  each  costing 

$10,000. 

3.  Time  on  a test  stand  costs  $1000  per 
month. 

It  is  readily  seen  that  the  experiment  will 
consume  a calendar  year  and  will  cost 
$132,000  just  to  set  it  up  and  run  it-as- 
suming  nothing  goes  wrong. 

Fractional  factorial  experiments  are  dis- 
cussed in  texts  on  experimental  design.  This 
is  a sophisticated  subject  and  requires  a 
knowledge  of  statistics  and  engineering. 

Only  full  factorial  designs  are  considered  in 
the  remainder  of  this  paragraph. 


The  assumption  is  made  in  analyzing  the 
data  that  all  measurements  are  actually  from 
the  same  population,  i.e.,  factors  and  levels 
have  absolutely  no  effect;  this  is  the  null 
hypothesis.  It  is  foreseen,  however,  that  the 
mean  lives  under  certain  conditions  may  not 
be  the  same;  this  is  then  taken  into  account 
in  calculating  the  various  sample  variances. 
Then  w'e  see,  according  to  the  actual  data, 
how  likely  we  were  to  get  the  results  we  got. 
If  the  results  would  be  very  unlikely-say 
less  than  1 chance  out  of  1000-we  usually 
then  reject  the  original  assumption.  The 
details  of  the  analysis  are  more  complicated, 
of  course. 

As  the  name  implies,  we  estimate  the 
variance  of  the  data  in  several  ways,  and 
then  compare  the  variance  estimates.  In 
order  to  make  the  comparison  feasible,  the 
variances  must  be  estimated  in  a particular 
way.  All  of  the  estimation  and  analysis  can 
be  performed  without  the  assumption  of  s- 
normality,  up  to  the  point  of  making  quan- 
titative s-significance  statements. 

Suppose  a population  has  a variance 

TABLE  2-14 

EXPERIMENT  ON  RADIO  RECEIVERS 


Eachx  represents  a measurement  of  life. 


Supply  Voltage  j 

Low 

Usual 

High 

Usual 

X 

X 

X 

X 

X 

X 

Ambient 

X 

X 

X 

Temperature  i 

X 

X 

X 

High 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

There  are  24  (2  X 3X'4=  24)  measurements  to  be 
made. 
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and  mean  m (the  distribution  need  not  be  s- 
normal).  Consider  samples  of  sizeiV,  and 
the  means  of  those  samples.  The  Xj  will 
have  variance  /N  and  mean  p.  For  ex- 
ample, in  Table  2-14,  if  we  take  the  mean  of 
each  sample  of  4 fA^  = 4)  in  each  box, 
those  means  will  have  a variance  cf  14. 

This  fact,  in  the  analysis  of  variance,  usually 
is  used  in  reverse:  if  the  variance  of  those 
means  is  ol,  then  = 4o^.  That  is,  we 
multiply  the  “variance  of  the  means”  by 
the  “sample  size”  to  get  the  original 
variance. 

When  estimating  a population  variance  from 
a sample  variance,  the  phrase  degrees-of- 
freedom  often  is  used.  The  degrees-of- 
freedom  for  a sample  is  the  number  of  s- 
independent  measurements  in  the  sample.  In 
the  usual  case  of  a simple  sample  of  N items, 
the  sample  mean  is  subtracted  from  each 
measurement:  the  sum  of  these  deviations  is 
zero.  Thus  only  N - 1 are  s-independent; 
once  you  know  those,  the  last  one  is  uni- 
quely determined.  In  the  analysis  of  vari- 
ance manipulations,  calculating  the  degrees- 
of-freedom  is  more  complicated  because  there 
are  many  subsample  means  used  in  the  cal- 
culations. 

The  big  trick  in  making  estimates  of  the 
population  variance  is  to  find  a set  of  mea- 
surements that  are  s-independent.  There  are 
many  ways  to  estimate  the  variance,  only  a 
few  of  them  are  useful.  After  a brief  dis- 
cussion of  notation,  the  useful  ways  of  esti- 
mating the  population  variance  will  be  shown. 

Use  the  following  notation: 

X = coded  experimental  value.  It 

has  subscripts.  All  values  of 
X are  measured  from  the  over- 
all mean;  i.e.,  the  overall 
mean  of  the  data  has  been 
subtracted  from  the  original 
experimental  value.  This 
simplifies  the  equations. 


i,  j,  k,  r 

= designates  the  factor  or  re- 
plication. 

/,  i,  k 

= subscripts,  i refers  to  the 
level  of  the  first  factor,  /to 
the  level  of  the  second,  k to 
the  level  of  the  third.  The 
unused  ones  are.  omitted 
when  appropriate. 

r 

= subscript  for  replication.  (It 
is  omitted  when  not  used.) 

It  follows  the  i,  /,  k. 

X 

= a mean  value  ofx.  A dot 
is  used  to  replace  the  index 
which  has  been  averaged  over. 

I,  J,  K 

= number  of  levels  assumed  by 
factors  i,  j,  k,  respectively. 

R 

= number  of  replications.  If 
r is  omitted,  it  is  equivalent 
to  2?  = l;e.g,,  1 replication 
means  1 measurement,  3 
replications  (R=  3)  means  3 
measurements. 

= implies  a sum  over  the  index 
0 from  1 to  '!>. 

SS 

= sum  of  squares;  the  subscripts 
i,  j,  k,  r show  what  variables 
the  sum  is  due  to. 

= degrees-of-freedom;  the  sub- 
scripts i,  j,  k,  r show  what 
variables  are  being  referred  to. 

= variance  estimate;  the  sub- 
scripts i,  j,  k,  r show  what 
variables  the  estimate  is  due 
to 

In  Table  2-14,  ambient  temperature  is  the 
first  factor  (i)  and  / = 2;  supply  voltage  is 
the  second  factor  (j)  and  / = 3;  there  is  no 
third  factor;  there  are  4 replications  and  R = 
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4.  The  general  variable  is  x^j.  means  an 
average  (in  cell  i,  /)  over  all  replications; 

X.  . . means  the  average  over  evervthing  and 
is  zero  by  definition  (see  x). 

2-7.2  CASE  I:  1 FACTOR,  WITH  REPLI- 
CATION, TABLE  2-15 

is  the  variable.  It  is  subdivided  as 
shown  in  Eq.  2-49. 

Xir  = (X{.)  + (xw  —X{.)  (2-49) 

Each  of  the  terms  in  ( ) in  Eq.  2-49  is  used 
to  estimate  the  variance. 

= Z{Zr(X{.)^  + ~ Xi.)^ 

(2-50) 

TABLE  2-15 

CASE  I:  1 FACTOR,  WITH 
REPLICATION 


(A)  GENERAL  CASE 


Factor  i 

1 2 

1 

Replication  1 

X X 

X 

2 

X X 

X 

3 

X X 

X 

R 

X X 

X 

(B)  EXAMPLE,  1 FACTOR, 
4 REPLICATIONS 

3 LEVELS, 

Factor  1 

Level:  1 

2 

3 

2.98 

-0.47 

0.04 

-0.39 

1.24 

-0.59 

-0.01 

-0.40 

-0.51 

-0.23 

-1.69 

0.03 

Mean  0.588 

-0.330 

-0.258 

Entries  adjusted  so  that  grand  average  is  zero. 


Eq.  2-50  uses  the  fact  that  the  cross  pro- 
ducts vanish  due  to  wise  choice  of  expres- 
sions in  the  ( );  this  wD.  be  true  in  all  cases. 

The  allocation  of  sums  of  squares  and 
degrees  of  freedom  is  most  easily  visualized 
in  a table.  This  case  is  shown  in  Table 
2-1 6(A).  The  residuals  estimate  of  the 
variance  is  used  as  a reference;  it  would 
give  the  common  within-factor  variance  even 
if  the  factors  were  causing  a shift  in  the 
means.  The  ratio  sf/s^  is  tested  by  means 
of  the  F statistic— the  distribution  of  the 
ratio  of  2 s-independent  5^  from  the  same 
population.  If  the  ratio  is  very  hi^ 

(rarely  exceeded)  it  is  doubtful  that  the  sj 
measures  only  the  common  variance;  there 
is  very  probably  a real  difference  in  the 
means. 

Example  No.  12  illustrates  the  case  of 
one  factor  with  replication. 

The  data  in  Table  2-1 5(B)  were  aetually 
all  taken  from  the  table  of  standard  s- 
normal  random  deviates  (zero  mean,  unit 
\ arianee)  in  Ref  25  (p.  396).  If  we  had  found 

TABLE  2-16 

ALLOCATION  OF  SUMS  OF  SQUARES  AND 
DEGREES  OF  FREEDOM 


(A)  Calculations  and  ALUxatkis  for  Cat*  I 
(The  overall  mean  Is  presumed  to  be  zero). 


Allocation 

SS 

s' 

F 

— 

— 

— 

i 

/-1 

sjVsJ 

r 

~ Xi 

.)’  tm-v 

SS,/v, 

- 

Total 

L,E,jcNy  /fl-1 

IB)  Example  for  Case  1;  / 

= 3,  fl  = 4 

Allocation 

SS 

V 

s' 

F 

— 

— 

— 

— 

i 

2.0848 

2 

1 .0424 

0.7572 

r 

12.3894 

9 

1 .3766 

— 

Total 

14.4708 

11 

- 

_ 

(The  total  does  not  agree  with  SSj  + SS,  because  of  roundoff  errors.) 
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Example  No.  12 

Table  2-15(B)  shows  some  simulated  experimental  data.  There  is  1 factor  i with 
3 levels.  The  question  is,  do  those  3 levels  actually  have  a real  effect?  For  example, 
level  1 appears  to  have  a much  higher  mean  than  do  the  other  2 levels. 


Procedure 

1.  Subtract  the  overall  mean  from  1. 

each  datum. 

2.  Find  the  mean  of  each  column.  2. 

3.  The  column  means  have  a disper-  3. 
sion.  Estimate  the  variance  of  the 
column  means. 


4.  Estimate  the  population  variance  4. 
from  the  column-mean  variance. 


5.  Estimate  the  variance  from  the  5. 
replications.  First,  get  the  sam- 
ple (column)  sums  cf  squares. 

Then  calculate  the  degrees  of 
freedom.  Calculate  the  Sp.  This 
is  an  estimate  of  the  population 
variance  because  it  was  derived 
from  individual  data,  not  the 
means. 


Example 

This  has  already  been  done  in  Table 
2-15(B). 

See  Table  2-15(B). 

The  mean  of  the  “column  means”  is  zero; 
so  the  sum  cf  squares  is  (0,588)^ 

+ (-  0. 330)^  + (-  0.  258)2  = 0.5212.  There 
are  3 columns  with  known  mean;  so  there 
are  Vf  = 2 (2=3  — 1)  degrees  of  freedom 
(for  the  numerator  in  step  6):  0.5212/2 
= 0.2606.  This  is  the  estimated  variance 
of  the  column  means. 

To  convert  it  to  the  estimated  population 
variance,  multiply  by  the  number  of  ele- 
ments in  each  column  (4).  Therefore 
Si  = 4 X 0.2606  = 1.0424. 

Column  1 sum  cf  squares  is 
(2.98  - 0.588)2  +(-  0.39  - 0.588)2 
+ (_  0.01  - 0.588)2  +(_  Q 23  - 0.588)2 
= 7.7049.  Column  2 sum  cf  squares  is 
4.3390.  Column  3 sum  of  squares  is 
0.3455.  The  total  replication  sum  of 
squares  is  7.7049  +4.3390  + 0.3455 
= 12.3894.  Each  column  has  3 (3  = 4—1) 
degrees  of  freedom  and  there  are  3 col- 
umns. There  are  3x3  = 9 degrees  of 
freedom  for  the  sum  of  squares;  there- 
fore V,  = 9 for  step  6.  Sp  = 12.3894/9 
= 1.3766. 
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Example  No.  12  (Contfd) 

6.  Compare  Sy  and  sj.  The  technique  6-  s|/s^  = 1.0424/1.3766  = 0.7572  = 2, 

for  doing  this  is  the  F distribution.  v,  = 0 from  steps  3 and  5.  Look  in  the  F 

tables  (Tables  2-17)  for  v = 2 in  the  nu- 
merator and  V = 9 in  the  denominator. 

The  critical  value  for  ,s-significanceat 
the  l*M)evel  is  given  in  Table  2-17  and  is 
8.02.  The  ratio  0.7572  is  much  less  than 
the  critical  value;  so  we  presume  that 
the  null  hypothesis  is  true,  i.  e.,  all  data 
are  random  samples  from  a single  popu- 
lation, there  is  no  real  difference  due  to 
the  levels  of  the  factor.  The  actual  value 
of  F corresponding  to  0.7572  is  50*%  (see 
Tables  in  Ref  13). 
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TABLE  2-17 


N> 

I 

00 

F-DISTRIBUTION,  F99  lv„,  v^)  (Ref.  18) 
Critical  values  for  the  1%(1%p  100%— 99%)  s-significance  level. 

Table  gives  the  value  of  F which  i s exceeded  only  1 %of  the  time. 

Pfj  = degrees  of  freedom  for  numerator;  = degrees  of  freedom  for  denominator 


\ 

2 

3 

4 

s 

6 

7 

s 

9 

10 

1 2 

15 

20 

24 

30 

40 

60 

120 

«0 

1 

4052 

4999.5 

5403 

5625 

5764 

5859 

5928 

5982 

6022 

6056 

6106 

6157 

6209 

6235 

6261 

6287 

6313 

6339 

'6366 

2 

98.50 

99.00 

99.17 

99.25 

99.30 

99.33 

99.36 

99.37 

99.39 

99.40 

99.42 

99.43  99.45 

99.46.  99.47 

99.47 

99.48 

99.4£ 

99.50 

3 

34.12 

30.82 

29.46 

28.71 

28.24 

27.91 

27.67 

27.49 

27.35 

27.23 

27.05 

26.87 

26.69 

26.60 

26.50 

26.41 

26.32 

2622; 

26.13 

4 

21.20 

18.00 

16.69 

15.98 

15.52 

15.21 

14.98 

14.80 

14.66 

14.55 

14.37 

14.20 

14.02 

13.93 

13.84 

13.75 

13.65 

13.5f 

13.46 

3 

16.26 

13.27 

12.06 

11.39 

10.97 

10.67 

10.46 

10.29 

10.16 

10.05 

9.89 

9.72 

9.55 

9.47 

9.38 

9.29 

9.20 

9.11 

9.02 

6 

13.75 

10.92 

9.78 

9.15 

8.75 

8.47  8.26 

8.10 

7.98 

7.87 

7.72 

7.56 

7.40 

7.31 

7.23 

7.14 

7.06 

6.91 

6.88 

7 

12.25 

9.55 

8.45 

7.85 

7.46 

7.19 

6.99 

6.84 

6.72 

6.62 

6.47 

6.31 

6.16 

6.07 

5.99 

5.91 

5.82 

5.74 

5.65 

t 

11.26 

8.65 

7.59 

7.01 

6.63 

6.37 

6.18 

6.03 

5.91 

5.81 

5.67 

5.52 

5.36 

5.28.  5.20 

5.12 

5.03 

4.95 

4.86 

9 

10.56 

8.02 

6.99 

6.42 

6.06 

5.80 

5.61 

5.47 

5.35 

5.26 

5.11 

4.96 

4.81 

4.73 

4.65 

4.57 

4.18 

4.4( 

4.31 

10 

10.04 

7.56 

6.55 

5.99 

5.64 

5.39 

5.20 

506 

4.94 

4.85 

4.71 

4.56 

4.41 

4.33 

4.25 

4.17 

4.08 

4.0c 

3.91 

11 

9.65 

7.21 

622 

3.67 

5.32 

5.07 

4.59 

4.74 

4.63 

4.54 

4.40 

4.25,  4.10 

4.02 

3.94 

3.86 

3.78 

3.65 

3.60 

12 

9.33 

6.93 

5.95 

5.41 

5.06 

4.82 

4.64 

450 

4.39 

4.30 

4.16 

4.01,  3.86 

3.78 

3.70 

3.62 

3.54 

3.4i 

3.36 

13 

9.07 

6.70 

5.74 

5.21 

4.86 

4.62 

4.44 

4.30 

4.19 

4.10 

3.96 

3.82  3.66 

3.59  3.51 

3.43 

3.34 

3.2c 

3.17 

14 

8.86 

6.51 

5.56 

5.04 

4.69 

4.46 

4.28 

4.14 

.4.03 

3.94 

3.80 

3.66 

3.51 

3.43 

3.35 

3.27 

3.18 

3.05 

3.00 

Is 

8.68 

6.36 

5.42 

4.89 

4.56 

4.32 

4.14 

400 

3.89 

3.80 

3.67 

3.52 

3.37 

3.29 

3.21 

3.13 

3.05 

2.9( 

2.87 

16 

8.53 

6.23 

5.29 

4.77 

4.44 

4.20 

4.03 

3.89 

3.78 

3.69 

3.55 

3.41 

3.26 

3.18,  3.10 

3.02 

2.93 

2.81 

2.75 

17 

8.4(» 

6.11 

5.18 

4.67 

4.34 

4.10 

3.93 

3.79 

3.68 

3.59 

3.46 

3.31.  3.16 

3.08  3.00 

2.92 

2.83 

2.7£ 

2.85 

18 

8.29 

6.01 

5.09 

4.58 

4.25 

4.01 

3.84 

3.71 

3.60 

3.51 

3.37 

323 

3.08 

3.00 

2.92 

2,84 

2.75 

2.6C 

2.57 

19 

8.18 

5.93 

5.01 

4.50 

4.17 

3.94 

3.77 

3.63 

3.52 

3.43 

3.30 

3.15 

3.00 

2.92 

2.84 

2.76 

2.67 

2.58 

2.49 

20 

8.10 

5.85 

4.94 

4.43 

4.10 

3.87 

3.70 

3.56 

3.46 

3.37 

3.23 

3.09 

2.94 

2.86 

2.78 

2.69 

2.61 

2;  52 

2.42 

21 

8.02 

5.78 

4.81 

4.37 

4.04 

3.81 

3.64 

3.51 

3.40 

3.31 

3.17 

3.03 

2.88 

2.80 

2.72 

2.64 

2.55 

2.46 

2.3C 

22 

7.95 

5.72 

4.82 

4.31 

3.99 

3.76 

3.59 

3.45 

3.35 

3.26 

3.12 

2.98 

2.83 

2.75 

2.67 

2.58 

2.50 

2.40 

23  1 

23 

7.88 

5.66 

4.76 

4.26 

3.94 

3.71 

3.54 

3.41 

3.30 

3.21 

3.07 

2.93 

2.78 

2.70 

2.62 

2.54 

2.45 

2.35 

2.26 

24 

7.82 

5.61 

4.72 

4.22 

3.90 

3.67 

3.50 

3.36 

3.26 

3.17 

3.03 

2.8^ 

2.74 

2.66 

2.58 

2.49 

2.40 

2.31 

2.2  1 

25 

7.77 

5.57 

4.68 

.4.18 

3.85 

3.63 

3.49 

3.32 

3.22 

3.13 

2.99 

2.85 

2.70 

2.62 

2.54 

2.45 

2.36 

2.27 

2.17 

26 

7.72 

5.53 

4. 64 

4.14 

3.82 

3.59 

3.42 

3.29 

3.18 

3.0s 

2.96 

2.81 

2.66 

2.58 

2.50 

2.42 

2.33 

2.23 

2.13 

27 

7.68 

5.49 

4.6( 

4.11 

3.78 

3.56 

3.39I 

3.26 

3.15 

3.00 

2.93 

2.78 

2.63 

2.55 

2.47 

2.38 

2.29 

2.20 

2.10 

28 

7.64 

5.45 

4.57 

4.07 

3.75 

3.53 

3.3(^ 

3.23 

3.12 

3.03 

2.96 

2.75 

2.60 

2.52 

2.44 

2.35 

2.26 

2.17 

2.06 

29 

7.C0 

5.42 

4.54 

4.04 

3.73 

3.50 

3.33i 

3.20 

3.09 

3.00 

2.87 

2.73 

2.57 

2.49 

2.41 

2.33 

2.23 

2.14 

2.03 

30 

7.56 

5.39 

4.51 

4.02 

3.70 

3.47 

3.3(1 

3.17 

3.07 

2.98 

2.84 

2.70 

2.55 

2.47 

2.39 

2.30 

2.21 

2.11 

2.01 

40 

7.31 

5.18 

4.31 

3.83 

3.51 

3.29 

3.12 

2.99 

2.89 

2.8C 

2.66 

2.52 

2.37 

2.29 

2.20 

2.11 

2.02 

1.92 

1.80 

60 

7.08 

4.98 

4.13 

3.65 

3.34 

3.12 

2.95 

2.82 

2.72 

2.63 

2.50 

2.35 

2.26 

2.12 

2.03 

1.94 

1.84 

1.73 

1.60 

120 

6.85 

4.79 

3.95 

3.48 

3.17 

2.96 

2.79 

2.66 

2.66 

2.47 

2.34 

2.19 

2.03 

1.95 

1.86 

1.76 

1.661 

1.53 

1.38 

00 

6.63 

4.61 

3.78 

3.32 

3.02 

2.80 

2.64 

2.51 

2.41 

2.32 

2.18 

2.04 

1.88 

1.79 

1.70 

1.59 

1.47 

1.32 

1.00 

(The  F<listributioti  is  sometimes  called  the  (^distribution;  it  is  the  ratio  of  2s-independent,s-unbiased  estimates  from  a single  s-normal  distribution.) 
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an  effect,  it  would  have  been  an  erroneous 
finding. 

This  is  about  the  simplest  possible  case. 
There  are  several  algebra  identities  for  re- 
ducing the  amount  of  arithmetic  (see  Ref. 

32,  for  example);  their  use  may  incur  round- 
ing errors  which  can  be  severe.  An  example 
of  rounding  errors  can  be  shown  using  the 
identity 

y = (a  + b)(a  — b)  = (2-51) 

Suppose  a = 100,003,  b = 100,002  and  the 
computer  has  only  6 significant  figures.  If 
the  factored  formula  is  used,  we  have 

(100,003  + 100,002)  (100,003  - 100,002) 

= 200,005  X 1 = 200,005. 

If  the  other  fonnula  is  used,  we  have 

100,003^  - 100,002^  = 100,006  X 10®  - 
100,004  X 10^  = 200,000. 

The  rounding  error  by  the  second  method 
caused  a loss  of  almost  1 significant  digit. 

Another  advantage  of  not  using  "short 
cut"  methods  is  that  one  has  a chance  to 
see  the  residuals  and  to  note  any  that  may 
be  anomalous. 

Most  analyses  actually  will  be  done  via  a 
computer  program.  Check  your  computer 
service  center  to  find  out  which  ones  are 
available  to  you. 

2-7.3  CASE  II:  2 FACTORS,  WITHOUT 
REPLICATION,  TABLE  2-18 

It  is  usually  a poor  idea  to  have  no  re- 
plication. Without  replication,  one  must 
resort  to  precarious  assumptions  to  estimate 
the  reference  for  the  population  variance. 

is  the  variable._  It  is  subdivided  as 
shown  in  Eq.  2-52  (x  . . . = 0). 


Xij  - (X{.)  + {x.  j)  + {.Xij  — Xi,  — X,  j) 

(2-52) 

It  can  be  shown  that,  as  in  Table  2- 18(A), 
the  sums  of  cross  products  vanish.  The 
difficulty  with  this  case  (no  replication)  is 
that  there  is  presumed  to  be  no  interaction; 
therefore  the  is  taken  as  the  reference 
for  the  F-ratio  test.  ■ Table  2- 18(B)  shows 
graphically  what  tests  are  run. 

2-7.4  CASE  III:  2 FACTORS,  WITH 
REPLICATION,  TABLE  2-19 

Xfjf  is  the  variable.  It  is  subdivided  as 
shown  in  Eq.  2-53. 

Xijr  = (X{.  .)  + (x.j.) 

^ iX  ij  • “X|»*  *X*^e) 

+ (xijr-X{j,)  (2-53) 

It  can  be  shown  that,  as  in  Table  2-19(A), 
the  sums  of  cross  products  vanish.  The  first 
2 terms  will  give  the  main  effects  of  the  2 
factors  i and  j;  the  3rd  term  gives  the  inter- 
action effect;  and  the  last  term  gives  the 
estimate  of  the  population  variance  from  the 
replication  (this  is  used  as  the  reference  for 
testing  the  other  effects).  Table  2-1 9(B) 
shows  the  experimental  layout;  there  are 
UR  experiments  to  be  run.  Table  2- 19(A) 
shows  that  there  are  3 F-tests.  If  the  s- 
significance  level  is  too  loose,  there  is  a 
good  chance  that  one  of  the  3 effects  will 
be  declared  s-significant  when  the  F-value 
is  hi^  just  due  to  chance. 

2-7.5  CASE  IV:  3 FACTORS,  WITHOUT 
REPLICATION,  TABLE  2-20 

As  in  Case  II,  it  is  usually  a poor  idea  to 
have  no  replication;  but  the  number  of  tests 
with  replication  can  be  prohibitive.  x,y^  is 
the  variable.  It  is  subdivided  as  shown  in 
Eq.  2-54.  (T  . . . = 0). 
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TABLE  2-18 


CASE  II;  ANALYSIS  VARIANCE,  2 FACTORS,  WITHOUT  REPLICATION 
(A)  Calculation  and  Allocations 

(The  overall  mean  x . . is  presumed 
to  be  zero.) 


Allocation  SS 

i 2/2y(x.y)"  _ 

ij  2y2y{x,y  ~Xi.  ~ X .y)  ^ 

Total  2;2y{X^y)^ 


V F 

/ - 1 SS/i/j  s?/s?j 

J-  1 SSj/Kj  Sj?/S?j 

(l-l)iJ-l) 

IJ  - A 


The  ij  implies  an  interaction  term. 


(B)  Experimental  Layout 
Each  X represents  an  experiment. 

Factor  i 

J i 

1 

2 

/ 

1 

X 

X ... 

X 

Factor  2 

i 

X 

X 

X 

J 

X 

X 

X 

• • ) *t"  • y • ) “i" 

4*  iiX( y« 

4“  * yft  ""  X 4 J ^ X ^ 

+ — 3?.  .ft  — ^j,,) 

4"  y • ^ Xfm  m **  ^ • y • ) 

■*“  Oc# yj^  ^ x^  Jm  X * * 

■—  X 0 9 fi  "“-I^Ja*) 

— (5C{.  .)  — Ocay.)  — (3c.  .ft)]  (2-54) 

The  first  3 terms  give  the  main  effects  due 
to  the  3 factors;  the  second  3 terms  give  the 
2-way  interaction  effects;  and  the  last  term 
in  [ 1 gives  the  3-way  interaction  term. 

The  [ . . . ] is  written  out  in  detail  to  show 
how  it  is  constructed;  it  can  be  simplified  in 
appearance  somewhat  as  in  Table  2-20(A). 
\^enever  a term  is  written  down,  all  further 


averages  must  be  subtracted  from  it;  in  the 
end,  the  identity  must  also  be  preserved. 

a.  The  first  3 terms  have  no  further 
averages  because  x.  . . = 0 (by  hypothesis; 
if  not,  X ...  is  subtracted  from  every 
reading). 

b.  Consider  the  first  2-way  interaction. 
The  x,y  . has  2 further  averages  x,-  . . and 
X.J.;  each  must  be  subtracted  from  x,y  . 

But  the  X,- . . and  x .y . have  no  further  (non- 
zero) averages  because  x . . . = 0.  The  same 
considerations  hold  for  the  other  2-way 
interactions. 

c.  The  3-way  interaction  term  begins  with 
x,yft  . It  has  3 further  averages  (over  each 

of  the  indexes);  each  of  those  averages  has 
2 further  averages -and just  repeats  the  2-way 
interaction  terms;  so  each  of  those  is  sub- 
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TABLE  2-19 

CASE  III;  ANALYSIS  OF  VARIANCE,  2 FACTORS  WITH  REPLICATION 

(A)  Calculations  and  AHocations 

(The  overall  meanx  ...  is  presumed 
to  be  zero.) 


Allocation 

SS 

V 

F 

j 

/-  1 

ss,/.i 

sf/s^ 

j 

J-  1 

SSj/.j 

ij 

~ xi..— X.J.)^ 

(l-1)(J-  1) 

SSij/r-ij 

r 

IJ(R  - 1) 

SSjPr 

- 

Total 

UR  - 1 

- 

- 

(B)  Experimental  Layout 
Eachx  representsan  experiment. 

Factor  i 

JL  Jl  — 

Factor  1 lx  x 

i 2 X x 

X X 

X X 

X X 

R X X X 


Rx 

2 I X 

2x 


X 

X 


J lx  X 

2 X X 


X 

X 


R X X 


X 


tracted.  Then  there  are  the  3 double  aver-  in  computer  calculations, 

ages  (Xj.  ,)etc.  which  must  be  subtracted;  if 

X . . . were  not  zero,  it  would  have  to  be  Table  2-20  shows  the  equations  and  experi- 

subttacted  every  time.  Then  the  triple  aver-  mental  layout.  Example  No.  1 3 illustrates 

age  X . . . would  have  to  be  subtracted  if  it  the  case  of  three  factors  without  replication, 

were  not  zero.  (This  shows  what  simplifi- 
cation is  achieved  by  making  "x  ...  = 0”; 

it  also  virtually  eliminates  roundoff  errors  [Text  continues  on  page  2-94.] 
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TABLE  2-20 

CASE  IV:  ANALYSIS  OF  VARIANCE,  3 FACTORS  WITHOUT  REPLICATION 


(A)  Calculations  and  allocations 
(The  overall  mean  x . , , is  presumed  to  be  zero,) 


allocation 

SS 

y 

^2 

F 

1 

I -1 

SSi/vi 

J 

J -1 

SS,/v, 

si/s^jk 

k 

K -1 

SSk/vt 

sl/sht 

ij 

-Xi..  -x.j.f 

iJ-lHJ- 

1) 

SS|j/ 

®ij/ ®ijk 

Jk 

'Lil.j'Lffhc.jft  — x.j.  — X. 

(J  -1)(K  - 

•1) 

SSjk/  Vjk 

kl 

ft  ~ • ft  x^, , ) 

1 

1 

1) 

SSki/t^l 

4i/sijk 

IJk 

^ij‘  ^<»ft 

+ Xi.,  + X.J  + X. 

(f  _ iw.r  _ i)(K-  _ 1) 

SS|jk/  Vjjk 

1 ^ V,  ^ JJK  ^ I 


I 

<0 


(B)  Experimental  Layout 
(Eachx  represents  an  experiment,  ) 

Factor! 


o 

<0 


1 

2 


K 

1 

2 


K 


o 

u 


1 

2 


K 


X 

X 


X 

X 


X 

X 

X 


X 


X 

X 


X 
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Example  No.  13 


There  are  serious  reliability  difficulties  with  the  gun/turret  drive-system  on  a 
heavy  tank.  A full  factorial  experiment  with  no  replication  is  to  be  run.  Factor  t is 
temperature  and  there  are  2 levels;  factory  is  vibration  and  there  are  3 levels;  fac- 
tor h is  humidity  and  there  are  2 levels.  There  are  12,  i.  e.,  (2x3x2=  12),  ex- 
periments. Table  2-21(B)  shows  the  data  for  this  case.  Each  datum  is  the  number 
of  10-hr  missions-to-failure. 


Procedure 


Example 


1.  Record  the  data.  Convert  to  1. 
“overall  mean  is  zero.” 

Begin  to  fill  out  a table. 

2.  Calculate  overall  averages  2. 
for  the  temperature  factor. 


3 . Calculate  overall  averages  3. 
for  the  other  factors 


Table  2-21(B)  is  the  original  data.  Subtract 
5.25  from  each  to  get  Table  2-21(C).  Begin 
Table  2-21(A)  (patterned  after  Table 
2-20(A)).  Cols.  1 and  3 can  be  completed. 

Xi..  = (4.75  +3.75  +2.75  +3.75 
- 0.25  - 0.25)/6  = 2.4167 

X2-.  = -2.4167. 

x.t.  = (4.75  - 1.25  +3.75  - 0.25)/4 
= 1.7500,  x.2‘  = 0.5000, 

x.i.  = — 2.2500; 

X.  .1  = (4.75  - 1.25  +2.75  - 2.25)/4 
= - 0.0833,  x..2  = 0.0833. 


4.  Asa  check,  the  sum  cf  the  4. 
factor  averages,  for  each 
factor,  must  be  zero. 

5.  Calculate  the  first  3 SB's:  t,  v,  5. 
h.  The  sums  shown  in  Table 
2-20(A)  can  be  simplified  be- 
cause, in  each  case,  2 sums 

are  trivial:  they  can  be  re- 
placed with  a multiplication. 

That  multiplication  is  also  ex- 
actly what  is  needed  to  convert 
the  variance  of  the  means  to  a 
variance  of  the  population. 

6.  Calculate  = SS/r' for  each  6. 
cf  the  3 factors. 


OK,  by  inspection. 

SSt  = 3 X 2 X [(2.4167)2  + (-  2.4167)2] 
= 6x  11.6809  = 70.0853 

SS,  = 2 X 2 X 8.3750  = 33.5000 

SSh  = 3 X 2 X 0,0139  = 0.0833 

Record  in  Table  2-21(A),  Col.  2. 


4 = 70.0853/1  = 70.0853 
4=  16.7500 

4 = 0.0833;  Record  in  Table  2-21(A)  Col.  4. 
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Example  No.  13  (Cont'd) 


7.  For  the  tv  interaction,  cal-  7. 
culate  the  xtr*  ■ 


8.  Calculate  the  t,vterms  and  8. 
the  sum  cf  squares.  Use 
the  results  from  steps  2,  3. 
Calculate  the 


9.  For  the  vh  interaction,  cal-  9. 
culate  the  “ 


10.  Calculate  the  V, A terms,  the  10. 
sum  of  squares,  and  the 


11.  For  the  ht  interactions,  cal-  11. 
culate  the  ft  . 


Xu.  = (4.75  +3,75)/2  = 4.25 

X12.  = (2.75  +3.75)/2  = 3.25 

Xi3.  = (-  0.25  - 0.25)/2  = - 0.25 

X21*  = - 0.75,  %22‘  = - 2.25,  X2S‘  ~ ~ 4.25. 

(4.25  - 2.4167  - 1.7500)2  = (0,  0833)2 
(3.25  - 2.4167  - 0.5000)2  = (0,3333)2 
(-  0.25  - 2.4167  + 2.2500)2  = (-  0.4167)2 
(-  0.75  +2.4167  - 1.7500)2  ^ (_  q q833)2 
(-  2.25  + 2.4167  - 0.5000)2  = (-  0.3333)' 

(-  4.25  +2.4167  +2.  2500)2  = (0.4167)2 
Total  0.5833 

Multiply  by  2 (H  = 2)  and  record  in  Table 
2-21(A)  Col.  2.  Divide  result  by  2 (v^,  = 2) 
and  record  in  Table  2-21(A) , Col.  4. 

x.ii  = (4.75  - l,25)/2  = 1.75 
X’i2  = 1.75,  X.21  = 0.25,  x>22  ~ 0.75 
^•31  = “ 2,  25,  x,32  = ~ 2.25. 

(1.75  - 1.7500  +0.0833)'  =(0,0833)2 
(1.75  - 1.7500  - 0.  0833)2  = (-  0.  0833)2 
(0.25  - 0.5000  + 0.  0833)2  = (-  0.  1667)2 
(0.75  - 0.5000  - 0.  0833)2  = (0. 1667)2 
(-  2.25  +2.2500  + 0.  0833)2  = (0.  0833)2 
(-  2.25  +2.2500  - 0.  0833)2  = (-  0.  0833)2 
Total  0.0833 

Multiply  by  2 (r  = 2)  and  record  in  Table 
2-21(A),  Col.  2.  Divide  result  by  2 (r'rt  = 2) 
and  record  in  Table  2-21(A),  Col.  4. 

XI.  1 = (4.75  + 2,75  - 0.25)/3  = 2,  4167 
X2.i  ~ — 2.5833 

XI. 2 = 2,4167,  X2.2  = - 2.2500. 
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Example  No.  13  (Cont'd) 

12.  Calculate  the  ft, i terms,  the  12.  (2.4167  + 0.0833  “ 2.4167)^  = (0.0833)^ 

sum  of  squares,  and  the  s^.  2.5833  + 0.0833  + 2.4167)^  = (-  0.  0833)^ 

(2.4167  - 0.0833  - 2.4167)^  = (-  0.  0833)^ 

(-2.2500  - 0.0833  + 2.4167)^  = (0.0834)^ 

Total  0.0278 

Multiply  by  3 (V  = 3)  and  record  in  Table 
2 -21(A),  Col,  2 Divide  result  by  1 (i^t  = 1) 
and  record  in  Table  2-21(A),  Col.  4. 

13.  (4.75  - 4.25  - 1.75  - 2.4167  + 2.4167 

+ 1.75  - 0.  0833)2  = (0.4167)2:  111 

(-1.25 -(■  0.75  -1.75  -1-2.5833  - 2.4167 
+ 1.75  - 0.  0833)2  = (-  0.  4167)2:  211 

(2.75  - 3.25  - 0.25  -2 . 4167 -l- 2. 4167 
+ 0.50  - 0.  0833)2  = (-  0.  3333)2.-  3^21 

(-  2.25  -t-2.25  - 0.25  -(-2.5833  - 2.4167 
+ 0.50  - 0.  0833)2  = (+  0. 3333)2 . 221 

(-  0.25  +0.25  +2.25  -2.4167  +2.4167 

- 2.25  - 0.  0833)2  = (-  0.  0833)2:  131 

(-  4.25  + 4.25  + 2.25  + 2.5833  - 2.4167 

- 2.25  - 0.  0833)2  ^ (o.0833)2;  231 

(3.75  -4.25  -1.75  - 2.4167  + 2.4167 
+ 1.75  +0.0833)2  = (-  0.4167)2:  112 

(-  0.25  +0.75  - 1.75  +2.25  - 2.4167 
+ 1.75  + 0.  0833)2  = (+  0.  4166)2:  212 

(3.75  - 3.25  - 0.75  - 2.4167  +2.4167 
+ 0.50  + 0.  0833)2  _ (0.3333)2:  122 

(-  2.25  +2.25  - 0.75  +2.25  - 2.4167 
+ 0.50  +0.0833)2  =(-  0.3334)2:  222 

(-  0.25  + 0.25  +2.25  - 2.4167  +2.4167 

- 2.25  + 0.  0833)2  = (0.0833)2;  132 

(-4.25  + 4.25  + 2.25  + 2.25  - 2.4167 
+ 2.25  + 0.0833)2  = (-  0.  0834)2  ; 232 

Total  1.1667;  record  in  Table  2-21(A),  Col. 
2.  Divide  by  2 (vt^i,  = 3-  Record  in  Table 
2-2KA),  Col.  4. 


13.  Calculate  the  terms  for  the 
tvh  interactions  (Table 
2-20(A),  the  sum  cf  squares, 
and  the  s2. 
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Example  No.  13  (Contfd) 

14.  Look  up  the  critical  F-val-  14.  Choose  1%-significance;  use  Table  2-17. 
lies 

Record  in  Table  2 -2 1(A),  Col.  6. 

15.  Look  up  actual  s-significance  15.  Use  Ref.  13.  Estimate  the  values.  Record 

levels.  (The  s-significance  in  Table  2-21(A),  Col.  7. 

levels  are  the  -survivor 
function,  i.  e.,  the  fraction 
cf  the  time  a value  cf  F is 
exceeded.  Low  values  of  s- 
significance  imply  an  effect; 
high  ones  do  not.) 
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TABLE  2-21 

CASE  IV:  LIFE  OF  A DRIVE  SYSTEM  FOR  THE  GUN/TURRET 
ON  A HEAVY  TANK 


#1 

(A)  Calculations  and  Allocations 
n #3  m #5 

#6 

Allocation 

SS 

V 

JF 

F 

1%s-signif 

approx. 

s-signif 

% 

t(0 

70.0853 

1 

70.0853 

120 

98.5 

0.8 

V 

33.500 

2 

16.7500 

28.7 

99.0 

4 

h 

0.0833 

1 

0.0833 

0.143 

98.5 

85 

tv 

1.1667 

2 

0.5833 

1.00 

99.0 

50 

vh 

0.1667 

2 

0.0833 

0.143 

99.0 

85 

ht 

0.0833 

1 

0.0833 

0.143 

98.5 

85 

tvh 

1.1667 

2 

0.5833 

- 

99.0 

50 

Totai<^>  1 

106.2520 

106.2500 

11 

- 

(B)  Experimental  Results^^^ 

Factor  t 

1 2 

1 JtL  10  4 

1 

Factor  v 2 9 5 

2 18  3 

2 9 3 

3 15  1 

2 5 1 

overall  mean  = 5.2500 
overalls  =3.1079 

Number  of  levels 


(C)  Modified  Experimental  Result 
(overall  mean  is  zero) 


vt 

1 

2 

1 

h 

1 

4.75 

-1.25 

2 

3.75 

-0.25 

2 

1 

2.75 

-2.25 

2 

3.75 

-2.25 

3 

1 

-0.25 

-4.25 

2 

-0.25 

-4.25 

overall  mean  = 0.0000 
overall  s = 3 . 1079 


humidity  h,  H = 2 
temperature  t,  T = 2 
vibration  v,  V = 3 

is  the  variable. 


Notes:  (1)  The  factorsare  t temperature,  h humidity,  and  vvibration. 

(2)  Col.  7 is  the  approximate  J.significanc8  for  the  F-values  in  Col.  5 
(Ref.  13). 

(3)  The  two  SS  totals  differ  because  of  roundoff  errors. 

(4)  Table  shows  the  number  of  10-hr  missions-toTailfor  each  combination  of 
factors. 
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TABLE  2-21  (Cont’d) 

( D ) Modified  (and  somewhat  controversial)  Analysis 
Calculations  and  Allocations 


#1 

#2 

#3 

#4 

#5 

#6 

F 

#7 

approx. 

Allocation 

SS 

7 

F 

% s-signif. 

s-signif.  % 

t 

70.0853 

1 

70.1 

190 

12.3 

<0.05 

V 

33.500 

2 

16.8 

45.4 

9.55 

<0.05 

h 

0.0833 

1 

0.0833 

0.226 

12.3 

93 

all  interactions 

2.5834 

7 

0.3691 

— 

_ 

_ 

Now  let  us  analyze  the  results  of  Example 
No.  13: 

1 . One  of  the  first  things  to  note  is  that 

the  low  V for  the  reference  s'^  = 2) 

causes  very  poor  ability  to  distinguish  very 
high  from  ordinary  ratios  of  the 

2.  The  temperature  effect  is  undoubted- 
ly important  (for  the  2 temperatures  tested) 
the  vibration  is  likely  to  be  important;  but 
none  of  the  other  effects  or  interactions  is 
likely  to  be  important. 

3.  This  is  a “fixed  effects”  analysis.  The 
levels  are  presumed  “fixed”,  not  to  be  a 
random  sample  from  all  possible  levels  of 
the  factor.  See  Refs.  31  and  32  or  a com- 
petent statistician  for  a fuller  discussion  of 
this  point. 

4.  If  more  tests  are  to  be  run,  they 
ought  to  be  on  temperature  and  vibration 
separately.  The  separate  tests  are  easier/ 
cheaper  to  run. 

5.  Since  there  was  no  replication,  it  was 
presumed  that  there  was  no  3-way  inter- 
action. From  the  looks  of  the  results,  it 

is  easy  to  assume  (see  conclusion  No.  2) 
that  none  of  the  2-way  interactions  is  im- 
portant. Some  (but  not  all,  or  even  most) 
statisticians  would  argue  that  there  is  now 
justification  for  lumping  all  SS’s  for  all 
interactions  together  and  to  estimate  the 
reference  s'^  as  (1.1667  + 0.1667  + 0.0833 
+ 1.1667)/(2  + 2 + 1 + 2)  = 0.3691  with  7 
degrees  of  freedom.  The  new  analysis  is 


shown  in  Table  2-21  (D).  It  declares,  more 
than  ever,  that  temperature  and  vibration 
are  most  important,  and  that  humidity  is 
negligible.  Such  remanipulations  must  be 
treated  with  caution;  consult  a competent 
statistician  before  basing  any  important 
decisions  on  them. 

6.  The  basic  data  themselves  are  very 
coarse.  It  is  unlikely  that  they  come  from  a 
s-normal  distribution.  A lognormal  would 
perhaps  be  more  appropriate.  The  reference 
population  standard  deviation  (from  Con- 
clusion No.  5)  is  about  0.61  mission.  By 
going  back  now  and  looking  at  Table 

2-2 1(B)  it  is  not  unreasonable  that  the 
humidity  effect  is  small.  In  3 cells,  there 
was  no  effect,  and  in  the  other  cells  there 
was  at  most  1 mission  difference. 

7.  After  running  such  an  expensive  test, 
the  small  extra  cost  of  several  analyses  is 
not  unreasonable.  The  only  unreasonable 
thing  would  be  to  place  much  importance 
on  results  at,  say,  the  5%  or  10%  s-signifi- 
cance  level,  because  these  will  occur  in  5% 
to  10%  of  the  calculations. 

2-8  REGRESSION  AND  CORRELATION 
ANALYSIS 

Variations  in  component  part  values  in- 
troduced by  manufacturing  processes  and 
variations  in  environmental  conditions  cause 
changes  in  circuit  or  equipment  character- 
istics which  may  affect  reliability  (Refs.  2 
and  6).  Numerical  relationships  that  relate 
reliability  to  design  variables  can  be  derived 
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using  linear  regression  analysis. 

Regression  analysis  is  a statistical  techni- 
que that  quantitatively  defines  the  “best” 
fit  of  a line  through  a set  of  data  points. 
Correlation  is  a related  technique  but  con- 
siders the  interdependence  of  the  variables 
rather  than  the  dependence  of  one  on  an- 
other. The  distinction  between  the  two 
techniques  can  be  rather  subtle  and  Refs. 

24  and  32  or  other  standard  works  ought  to 
be  consulted.  Consider  leakage  current  and 
life  of  a transistor.  It  cannot  be  said  that 
one  causes  the  other  (although  they  may 
have  common  causes);  so  one  might  be  in- 
terested in  their  correlation.  But  if  one  is 
interested  in  predicting  the  life  by  measuring 
the  leakage  current,  then  regression  is  used. 

As  another  example  consider  the-  ambient 
temperature  and  the  life  of  a transistor. 

From  a physical  point  of  view,  it  is  not  use- 
ful to  speak  of  life’s  causing  the  ambient 
temperature,  only  the  other  way  around;  so 
one  is  interested  only  in  regression. 

As  used  in  this  chapter,  and  in  many 
statistical  treatments,  regression  implies 
linear  regression,  and  correlation  implies  lin- 
ear correlation.  Further,  this  chapter  con- 
siders only  2 variables.  For  more  extensive 
treatments,  see  Refs.  12,  17,  24,  and  32  or 
other  statistical  texts.  The  problem  is  to 
find  the  “best”  straight  line  for  the  test  data. 

In  linear  regression,  Eqs.  2-55  and  2-56  are 
assumed 

y = mx'  + V + (2-55) 

y — mx'  b'  (2—56) 

where 

7 = dependent  variable  (a  function  of 

x') 

x'  = independent  variable 

m = slope  of  the  line 


b’  = y-axis  intercept  of  the  line 

e = standard  s-normal  variate 

a = a standard  deviation  of  y from  y 

Y = “mean”  value  of  y (a  function  of 

x').  It  is  averaged  over  e. 

i = subscript  denoting  a particular  set 
of  measured  values  (the  e,.  is  not 
actually  measured,  it  is  there  to 
make  an  equality)  i = I , . . . ,N 

Xj  = implies  the  sum  over  all  N test 
data 

N = number  of  test  data  pairs 

“Best”  fit  is  usually  defined  as  the  “least- 
squares”  fit,  i.e,,  a minimum,  by 

adjusting  m and  b When  e is  a standard 
s-normal  variate,  the  maximum  likelihood 
solution  implies  the  least-squares  solution. 

It  is  convenient  to  redefine  the  x'  and  b’ 
as  follows: 

a'  s (Sjxij/jV 

X = x'  — a' 

X{  = X{  — a' 

b = ma'  + b'  (2-57) 

Then  the  Eqs.  2-55  and  2-56  become 

y = mx  + b + 0€  (2-58) 

y = mx  + b (2-59) 

The  randomness  inj  can  be  caused  by 
measuring  techniques,  experimental  uncer- 
tainties, and/or  component  part  variations. 

The  least-squares  solution  is 

S = (Si3)j)/lV  (2-60) 
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m = (j:iX{yi)/(I,iX{)  (2-61) 

= = - (mx{  + S)]2}/(A^  - 2) 

= [Xi(yi  - bf  - m^-Lix\y(N  - 2) 

(2-62) 


The  uncertainties  in  b,  m,  and  y'^  are 
measured  by 

Var{b}  =ctVa^ 

Var{w}  = (rV(2(JCj) 

Cov{mt,  &}  = 0 (2-63) 

Var{3?*bv)}  = Var{S}  + x'^'Wax{m}  (2-64) 

where  * is  a value  of  y to  be  predicted 
from  X. 

Those  uncertainties  are  usually  estimated 
by  substituting  for  . Eq.  2-64  is  most 
important  because  it  shows  the  “lever-arm” 
effect.  Forx  large  enough,  the  standard 
deviation  of  y*  is  directly  proportional  to 
x;  this  means  that  the  uncertainty  in  extra- 
polation can  be  tremendous.  Eq.  2-63^  can 
be  used  to  put  s-confidence  limits  on  b and 
m.  Eq.  2-64  gives  prediction  limits  for  y* 

(x).  Student  t-distribution  is  usually  used. 

One  ought  never  to  calculate  ay*  (x) 
without  also  estimating  its  standard  devia- 
tion by  means  of  Eq.  2-64;  it  is  very  often  an 
unpleasant  surprise.  If,  in  addition  to 
y*  (x),  one  wishes  the  uncertainty  in  y*, 
then  0^  must  be  added  to  Var  |y*|  . 

The  linear  correlation  coefficient  p be- 
tween y and  x is 


Cov{x,y} 

^ VVar(x)  Var{y) 
It  is  estimated  by 


(2-65) 


’^iXjyi 


(2-66a) 


(2-66b) 


p2  = 1 


2j(yf  - b)'^/{N  - 2) 


(2-66c) 


The  sampling  distribution  of  p is  given  in 
Refs.  1 8 and  30  and  elsewhere.  For  small 
sample  sizes,  the  uncertainty  in  p,  given  p, 
is  distressingly  large.  For  example,  if  p = 0 
and  = 10,  then  5%  of  the  time  Ipi  will 
be  greater  than  0.57;  or  if  p = 0.5  and 
N - 10,  95%  s-confidence  limits  on  p are 
- 0.18  and  + 0.84. 

Example  No.  14  illustrates  the  procedure. 


2-9  ACCEPT/REJECT  TESTS^  TEST  FOR 
MEAN  OF  A s-NORMAL  DISTRIBU- 
TION 

Tests  can  verify  that  an  equipment  meets 
a minimum  level  or  they  can  be  used  to 
compare  and  select  the  more  reliable  unit 
or  approach  from  several  alternatives.  These 
tests  can  be  used  during  system  design  and 
development  to  provide  guidance  to  the 
engineers  who  must  select  among  alternate 
designs  (Ref  18).  A typical  statement  of 
alternatives  is  (Ref  18): 


1 . There  is  a difference  between  the  re- 
liability of  the  units. 

2.  No  difference  has  been  demonstrated. 


Another  statement  of  alternatives  is: 

1.  The  reliability  of  equipment  A is 
greater  than  that  of  equipment  B. 

2.  There  is  no  reason  to  believe  that  the 
reliability  of  equipment  A is  greater  than 
that  of  equipment  B. 

Statistical  tests  are  applied  to  the  data  and  a 
decision  is  made  between  the  two  alterna- 
tives. The  hypotheses  are  selected  prior  to 
the  test. 

Because  test  information  usually  is  ob- 
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Example  No.  14  (Ref.  2) 


A turbojet  engine  is  experiencing  blade-fatigue  failures  due  to  excessive  vibra- 
tions at  resonance.  A test  is  to  be  run  to  determine  whether  a relationship  exists  be- 
tween bench-measured  blade  resonance  points  and  the  actual  rpm  at  which  the  blade 
reaches  resonance.  If  this  is  established,  it  may  be  possible,  by  nondestructive 
bench  measurements,  to  determine  the  acceptability  of  blades  for  actual  engine  use, 
reducing  or  eliminating  this  engine  failure  mode. 

Thirty  blades  are  selected  at  random  and  tested  sequentially.  The  test  consists 
of  building  up  engine  speed  and  recording  the  rpm  at  which  resonance  occurs  and  the 
resonant  frequency.  The  test  data  are  given  in  Table  2-22.  Compute  the  linear  re- 
gression equation  and  the  associated  statistical  quantities. 

Procedure  Example 


1.  Plot  the  data  to  see  what 
they  look  like 

2.  Calculate  the  deviations 
from  the  mean  for  the 
bench  resonant  frequen- 
cies. 

3.  Calculate  2 

4.  Calculate  2jy^. 

5.  Calculate 

6.  Calculate  b and  m from 
Eqs.  2-60  and  2-61. 


1.  See  Fig.  2-13.  They  look  reasonable  enough. 


2.  Fill  in  the  X column  in  Table  2-22, 


3.  2^4  = 223,266.70. 

4.  2 j3>,  = 322,200. 

5.  — 2,  608, 330. 

6.  S = 10,  740 
m = 11.683 
a = 1085.1. 


7.  Calculate  each  e^, 

= yf  ~ (mxi  +S)  then 
calculates^  =(2j€?)/ 
(M-2). 


a Estimate  V ar  {&}  and 
Var  {m}.  Use  Eq.  2-63. 


7.  = 50175.5 

s = 224. 0. 

a Var  {&}«  50178.2/30  = 1672.5  = 40.  9^ 

Var  {m}«  50178.2/223,266,7  = 0.2247  =0.4741^ 
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Example  No.  15  (Contfd) 


9.  Write  the  equation  for 
Var  {y*(jc}}. 

10.  Calculate  Var  {y*hc)} 
for  several  x. 


11.  Calculate  the  linear 
correlation  coefficient. 
Use  Eq.  2-66c. 


9.  Var{y*0r)}-«  1672.5  +0.224.1%'^  -h  50175.5 
= 51,848  +0.2247x^. 


10.  X = 200 

Var  {y*(200)}  =51848  + 8988  = 60836 
= 2472 

Var  {>^*(100)}  = 54095  = 233^ 

Var  {)»*(0)}=  228^ 


11.  - 6)2  = 31,877,000 

- 6)V(N  - 2)  = 31,  877,  000/28  = (1066. 99) 


,2_,  _/J24.0  \\ 
. 99/ 


^ ^ ” U066 

p = 0.978. 


956 


12.  Use  Table  1 5 of  Ref  30 
to  get  95%s-confidence 
limits  for  p. 


12.  The  chart  is  not  clear  for  such  a high  p,  but  it 
appears  that  Conf  {0. 95  s p 0.99)  = 95%.  In 
any  event,  the  linear  correlation  is  very  high. 
Virtually  all  the  original  variance  iny  is  ex- 
plained by  the  regression. 


The  statistical  data  have  all  been  gathered.  It  now  remains  to  interpret  it.  With 
V =28,  it  makes  little  difference  whether  Student  t-distribution  is  used,  orthes-nor- 
mal  distribution.  One  could  use  a goodness-of-fit  test  on  the  to  see  if  they  could 
reasonably  have  come  from  a s-normal  distribution.  More  disturbing  are  the  very 
high  deviations  of  blade  6,  and  the  fact  that  the  I e I appears  greater  for  the  half  of  the 
sample  with  higher  resonant  frequency. 


If  the  engine  operating  requirements  can  be  satisfied  with  the  present  knowledge, 
no  further  experimental  or  statistical  tests  are  needed.  But  remember,  1/30  of  the 
sample  had  a deviation  exceeding  ± 3 standard  deviations.  Do  not  blindly  forget  the 
sample  and  then  make  predictions  cf  the  population  based  on  some  abstract  statistical 
procedures.  Statistics  can  only  answer  the  questions  it  is  asked.  If  you  don’t  ask  the 
“right”  questions,  you  will  get  answers  to  irrelevant  questions. 
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TABLE  2-22 

REGRESSION  TEST  RESULTS  FOR  TURBINE  BLADES 


Blade  No. 

Resonance 

Blade  No. 

Resonance 

/ 

X 

X 

y 

E 

x' 

X 

Y 

E 

Frequency, 

Hz 

rpm 

Frequency, 

Hz 

rpm 

7 

960 

-125.1 

9400 

+121.5 

27 

1062 

- 23.1 

10550 

79.9 

18 

969 

-116.1 

9400 

+ 16.3 

3 

1069 

- 16.1 

10700 

148.1 

2 

986 

- 99.1 

9550 

- 32.3 

11 

1078 

- 7.1 

10550 

-1 07.1 

28 

988 

- 97.1 

9750 

144.4 

17 

1085 

- 0.1 

10800 

612 

1 

998 

- 87.1 

9650 

- 72.4 

5 

1090 

4.9 

10650 

-147.2 

16 

998 

- 87.1 

9850 

+127.6 

22 

1130 

44.9 

11000 

-264.5 

21 

1011 

- 74.1 

9800 

- 74.3 

26 

1149 

63.9 

11400 

- 86.5 

9 

1012 

- 73.1 

10100 

214.0 

29 

1169 

83.9 

11900 

179.8 

8 

1025 

- 60.1 

10000 

- 37.9 

30 

1180 

94.9 

11750 

- 98.7 

12 

1035 

- 50.1 

10300 

145.3 

4 

1181 

95.9 

11600 

-260.4 

23 

1042 

- 43.1 

10000 

-236.5 

13 

1190 

104.9 

11900 

- 65.5 

25 

1043 

- 42.1 

10200 

- 48.2 

19 

1215 

129.9 

11950 

-307.6 

10 

1047 

- 38.1 

10300 

+ 5.1 

24 

1217 

131.9 

12200 

- 80.9 

20 

1055 

- 30.1 

10500 

111.6 

14 

1240 

154.9 

12350 

-199.6 

15 

1058 

- 27.1 

10300 

-123.1 

6 

1271 

185.9 

13800 

888.2 

Units  are  omitted  in  the  caicuiations. 
Mean  of  x'  = a = 1085.10 


tained  by  means  of  a statistical  sampling 
procedure,  there  is  a chance  of  making  an 
incorrect  decision.  The  probability  of 
making  an  incorrect  decision  usually  can  be 
reduced  by  increasing  the  number  of  sam- 
ples tested.  Two  types  of  wrong  decisions 
are  possible; 

1.  It  is  concluded  that  there  is  a differ- 
ence but,  in  fact,  there  is  none  (Error  of  the 
First  Kind).  The  probability  of  making  this 
error  is  denoted  by  cy. 

2.  It  is  concluded  that  there  is  no  differ- 
ence but,  in  fact,  there  is  one  (Error  of  the 
Second  Kind).  The  probability  of  making 
this  error  is  denoted  by  i8. 

The  probability  of  an  Error  of  the  Second 
Kind  is  related  to  the  size  of  the  difference 
5 being  measured.  The  value  of  associated 
with  a particular  6 decreases  as  6 increases. 
For  a specific  statistical  test,  the  ability  to 


detect  a difference  is  determined  by  a,  (3 
(for  a given  5),  and  N the  sample  size.  The 
quantity  1 - 18  (6)  is  called  the  Power  of 
the  test  to  detect  a difference  6 with  a 
sample  of  size  N when  the  test  is  performed 
at  an  o level  of  s-significance.  The  relation- 
ship between  these  parameters  can  be  de- 
scribed graphically  by  an  Operating  Char- 
acteristic (OC)  curve.  These  curves  describe 
the  discriminatory  power  of  a test.  There  is 
a unique  OC  curve  that  corresponds  to 
specified  values  of  N and  cy.  These  and  other 
kinds  of  OC  curves  are  discussed  in  greater 
detail  in  Chapter  3. 

Two  basic  types  of  tests  can  be  con- 
sidered : 

1 . Does  the  mean  differ  from  a specified 
requirement? 

2.  Does  the  mean  of  one  design  differ 
from  the  mean  of  another  design? 
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Figure  2- 13.  Scattergram  of  Test  Data  for  Turbine  Biade^ 


The  first  test  can  sometimes  be  used  to 
determine  if  a product  meets  its  contractual 
reliability  requirements.  The  second  can  be 
used  to  compare  one  design  with  another 
(Ref.  18). 

The  relationships  to  be  used  in  performing 
these  tests  are  summarized  in  Tables  2-23 
and  2-24.  Table  2-23  presents  the  tech- 
niques for  comparing  the  mean  life  of  a 
product  with  a previously  defined  standard. 
The  variance  may  either  be  known  in  ad- 
vance or  estimated  from  the  data.  Table 
2-24  presents  the  techniques  for  testing  one 
design  against  another.  Again,  the  condi- 
tions of  both  known  and  unknown  variance 


are  considered.  Sample  sizes  can  be  esti- 
mated from  Table  2-25  and  2-26. 

Example  No.  15  illustrates  the  procedure. 

2-10  ACCEPT/REJECT  TESTS-BINOMIAL 
PARAMETER 

Tests  of  hypothesis  and  s-significance  can 
be  perfonned  on  the  binomial  parameter. 
These  techniques  can  be  used  to  compare 
s-reli abilities  of  various  designs  and  for  com- 
paring achieved  s-reliability  with  a require- 
ment. These  procedures  are  described  in 
Ref.  18.  [Text  continues  on  page  2-109.] 
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Example  No.  15 

A certain  fuse  is  experiencing  reliability  problems.  It  is  redesigned  and  both 
fuse  designs  are  tested  to  determine  if  the  new  designs  have  s -significantly  better  re- 
liability. The  fuses  c£  original  design  have  an  estimated  mean  life  of  30,000  hr  with 
an  estimated  standard  deviation  of  500  hr  (100  fuses  tested),  and  the  redesigned  fuses 
have  an  estimated  mean  life  of  31,000  hr  with  an  estimated  standard  deviation  of 
560  hr  (100  fuses  tested).  Does  the  redesigned  fuse  have  better  reliability  atthe  90% 
level  cf  s -confidence. 


Procedure  Example 


lA.  State  the  parameters  of  the  lA. 

problem.  Assume  that  the 
standard  deviation  estimate 
was  the  s-statistic. 


IB,  Make  the  explicit  assumption 
of  s- normality  for  both  fusede= 
signs. 

1C  . Be  explicit  about  the  measure 
of  reliability. 

ID.  Assume  (Ta  **  <tb> 

2.  Compute  the  degrees  of  free- 
dom from  Table  2-24 

V = .A/a  + Afg  — 2, 

3.  Compute  Sjp  from  Table  2-24 

2 ^ (AfA  - Dsi  + OVb  - 1)SB 

AIa  +A/b  - 2 

4.  Determine  the  critical  value  of 
t for  1-sided  90%  s-confidence, 
from  Table  2-27. 

5.  Compute 

/ 1 , 1 V'* 

u = , an  uncer- 

tainty in  the  difference  of  the 
means. 


= 31,000,  Ab  = 30,000 
Sa  = 560,  SB  = 500. 

The  units  cf  hours  will  be  implied  for 

X and  s. 

Na,  = 100,  A/b  = 100. 


1C.  The  measure  cf  reliability  valL  be  the 
true  mean-life  of  the  fuse. 

2.  V = 100  + 100  - 2 = 198. 

- , (100-  1)(560)^  + (100-  1X500)^ 

100  + 100-2 

Sp  = 531. 

4.  For  u = 198  and  1-sided  90% s-confidence, 
f = 1.28. 

/I  1 

5.  «=128(63U(j5j-+£3^) 

= 96. 


2-101 


AMCP  706-198 


6.  Compute  6.  ATa.  - Xb  = 31,000  - 30,000  = 1000. 

Xa  -Xb. 

7.  Compare  (Xa —Xb)  to  M.  7.  1000  > 96. 

The  redesigned  fuse  has  a greater  mean  life  than  the  original  one  at  90%  level  of  s- 
confidence.  The  difference  is  s-significant  at  the  10%level,:  indeed,  it  is  s-signifi- 
cant  at  the  0.5%  level  (and  probably  at  any  feasible  level).  But  is  it  significant,  i.  e., 
is  it  important  in  an  engineering  sense?  The  improvement  is  small,  approximately 
3% in  mean  life.  There  might  be  a slight  degradation  in  standard  deviation,  although 
not  an  important  one.  If  the  new  design  has  any  disadvantages  at  all,  it  may  be  better 
to  leave  things  as  they  are;  3%  is  a small  change,  it  could  be  lost,  for  example,  in 
month-to-month  or  batch- to- batch  variations. 
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TABLE  2-23 

SUMMARY  OF  TECHNIQUES  FOR  COMPARING  THE  AVERAGE  OF  A NEW 
PRODUCT  WITH  THAT  OF  A STANDARD** 


We  Wish 
T 0 Test 
Whether 

Knowledge  of 
Variation  of 
New  Item 

Test  To 
Be  Made 

Sample  Size 
Required 

Notes 

m differs 
from  mg 

(T  unknown; 
s = estimate  of  cr 
from  sample. 

\X  — mgl  )m 

Use  Table  2-25  for 
CY  = 0.05,  add  2 to 
tabular  value.  For 
CY  = 0.01,  add  4 to 
tabular  value . 

(t  for N — 1 de- 
grees of  free- 
dom 

cr  known 

I X - mg  I ) M 

Use  Table  2-25 

“ = /2  (t^) 

m is  larger 
than  mg 

cr  unknown; 
s = estimate  cf  cr 
from  sample 

(X  - mg) ) u 

Use  T able  2-26  for 
K = 0.05,  add  2 to 
tabular  value.  For 
a = 0.01,  add  3 to 
tabular  value. 

“ (^) 

it  for X - 1 de- 
grees at  free- 
dom) 

cr  known 

(X  - mg) ) u 

Use  Table  2-26 

m is  smaller 
than  mg 

cT  unknown; 
s = estimate  of  cr 
from  sample. 

(mg  - X)  > M 

Use  Table  2-26  for 
a = 0.05,  add  2 to 
tabular  value.  For 
CY  = 0.01,  add  3 to 
tabular  value. 

{t  for  X — 1 de- 
grees of  free- 
dom) 

cr  known 

(mg  - X))u 

Use  T able  2-26 

t = standard  Student  t variate;  see  Table  2-27. 
z = standard  s-normal  variate 
m = mean  life  at  new  produet 
mg  = mean  life  of  standard 

X = arithmetie  mean  of  the  new-produet  test  data. 
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We  Wish 
To  Test 
Whether 

differs 
from  nr.^ 


SUMMARY  OF  TECHNIQUES  FOR  COMPARING  THE  AVERAGE 
PERFORMANCE  OF  TWO  PRODUCTS** 


Knowledge 

of 

Variation 


Tests 
to  be 
Made 


Determina- 
tion of 
Sample  Size 
N 


Notes 


cr^  Ob;  both 
unknown 


(Tx  o'b;  both 
unknown 


^A.  Ob  both 
unknown 


I JCa  - Xg  I ) m,  where 


IXf,  — XbI>m,  where 


— -X'bI)m,  where 


Nr, 


Use  Table  2-25 
For  a = 0.05,  add 
1 to  tabular  val- 
ue. For  a = 0.01, 
add  2 to  tabu- 
lar value. 


Use  Table  2-25 


'(Na  - 1)4  1)4 


r = Af  A + A^b  - 2 


t is  the  value  of  li..c«/2 
for  the  effective  num- 
ber dT  degrees  of  free- 
dom 

. (5jl/AfA  + S^ATb)^ 

(sa/^a)^  , (s|/A^b) 

iVA  + 1 iVe  + 1 
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TABLE  2-24  (Confd) 


V\feWish 
To  Test 
Whether 


»?A  > Wb 


Knowledge 

Tests 

Determina- 
tion of 

of 

Variation 

to  be 
Made 

Sample  Size 
N 

Notes 

cta  aa;  both 
unknown 

^ “f  vvhere 

..  _ ..  ..  Aa  + 

(^i-a)spy 

Use  Table  2-26 
For  a = 0.05,  add  1 
to  tabular  value. 

For  Q!  = 0.01 , add  2 

Ma  - 1)4  + (iVB  - 1)4 

n = AIa  + A^B  - 2 

cta  ^ Tb;  both 
unknown 

{Xa  ~ -^b))«.  where 

to  tabular  value. 

V is  the  value  of  ^i.a 

u = /^  + £l- 

WaTa  Nb 

for  the  effective  number 
of  degrees  of  freedom 

(s\/K^  + sl/Nnf  o 
(4/)Va)'  , isl/N^)^ 

ATa  + 1 ATb  + 1 

CTa,  c7b  both 

(Xa  — Xb)  ) m,  where 

Use  Table  2-26 

unknown 

/oa 

« - 

V = degrees  of  freedom 

t = standard  Student  t variate;  see  T able  2-27 
z = standard  s-normal  variate 

m = mean  life  of  product,  used  with  subscript  A or  B 
X = arithmetic  mean  of  product  test  data,  used  with  subscript  A or  B 
subscript  A = product  A 
subscript  B = product  B 
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TABLE  2-25  SAMPLE  SIZES  REQUIRED  TO  DETECT  PRESCRIBED  DIFFERENCES 
BETWEEN  AVERAGES  WHEN  THE  SIGN  OF  THE  DIFFERENCE  B NOT  IMPORTANT** 

The  table  entry  is  the  sample  size  W required  to  detect,  with  probability  1-/3,  that  the  average  m 
of  a new  product  differs  from  the  standard  rtio  (or  that  two  product  averages  and  differ).  The 
standardized  difference  is  d,  w here 

d = ~ (or  d = K*  ~ if  we  are  comparing  two  products). 

The  standard  deviations  are  assumed  to  be  known,  and  N is  determined  by  the  formula: 

_ (Zl-a/i  + Zl-g)’’ 

a = .01 


d 

.50 

.60 

.70 

.80 

.90 

.95 

.99 

.1 

664 

801 

962 

1168 

1488 

1782 

2404 

.2 

166 

201 

241 

292 

372 

446 

601 

.4 

42 

51 

61 

73 

93 

112 

151 

.6 

19 

23 

27 

33 

42 

50 

67 

.8 

11 

13 

16 

19 

24 

28 

38 

1.0 

7 

9 

10 

12 

15 

18 

25 

1.2 

5 

6 

7 

9 

11 

13 

17 

1.4 

4 

5 

5 

6 

8 

10 

13 

1.6 

3 

4 

4 

5 

6 

7 

10 

1.8 

3 

3 

3 

4 

5 

6 

8 

2.0 

2 

3 

3 

3 

4 

5 

7 

3.0 

1 

1 

2 

. 1 

2 

2 

3 

ff  we  must  estimate  a from  our  sample  aud  use  Studeut's  t,  thcu  we  should  add  4 to  the  tabulated  values  to  obtaiu 
the  approximate  required  sample  size.  (If  we  are  compariug  two  product  average-s,  add  2 to  the  tabulated  values,  to 
obtaiu  the  required  size  cf  each  sample.  For  this  case,  we  must  have  = 1^.). 


a = .05 


1-0 

d 

.50 

.60 

.70 

.80 

.90 

.95 

.99 

.1 

385 

490 

618 

785 

1051 

1300 

1838 

.2 

97 

123 

155 

197 

263 

325 

460 

.4 

25 

31 

39 

50 

66 

82 

115 

.6 

11 

14 

18 

22 

30 

37 

52 

.8 

7 

8 

10 

13 

17 

21 

29 

1.0 

4 

5 

7 

8 

11 

13 

19 

1.2 

3 

4 

5 

6 

8 

10 

13 

1.4 

2 

3 

4 

5 

6 

7 

10 

1.6 

2 

2 

3 

4 

5 

6 

8 

1.8 

2 

2 

2 

3 

4 

5 

6 

2.0 

1 

2 

2 

2 

3 

4 

5 

3.0 

1 

1 

1 

1 

2 

2 

3 

If  we  must  estimate  a from  our  sample  aud  use  Student  t,  then  we  should  add  2 to  the  tabulated  values  to  obtain 
the  approximate  required  sample  size.  (If  we  are  comparing  two  product  averages,  add  1 to  the  tabulated  values  to 
obtain  the  required  size  of  each  sample.  For  this  case,  we  must  have  = ir,,.). 
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TABLE  2-26  SAMPLE  SIZES  REQUIRED  TO  DETECT  PRESCRIBED  DIFFERENCES  BETWEEN 
AVERAGES  WHEN  THE  SIGN  OF  THE  DIFFERENCE  IS  IMPORTANT' « 

The  table  entry  is  the  sample  size  (N)  required  to  detect  with  probability  1—0  that: 

(a)  the  average  m cf  a new  product  exceeds  that  cf  a standard  mo 

(b)  the  average  m cf  a new  product  is  less  than  that  cf  a standard  mo 

( c)  the  average  of  a specified  product  m^  exceeds  the  average  of  another  specified  product  wib. 
The  standardized  difference  is  d,  where; 

(a)  d = 

<r 


(b) 

(c) 


mo  — m 


rriK 


mB 


' A + ''b 

The  standard  deviations  are  assumed  to  be  known,  and  N is  calculated  from  the  following  formula: 

(2l_„  + 


N = 


a = .01 


1-/3 

d 

.50 

.60 

.70 

.80 

.90 

.95 

.99 

.1 

542 

666 

813 

1004 

1302 

1578 

2165 

.2 

136 

167 

204 

251 

326 

395 

542 

.4 

34 

42 

51 

63 

82 

99 

136 

.6 

16 

19 

23 

28 

37 

44 

61 

.8 

9 

11 

13 

16 

21 

25 

34 

1.0 

6 

7 

9 

11 

14 

16 

22 

1.2 

4 

5 

6 

7 

10 

11 

16 

1.4 

3 

4 

5 

6 

7 

9 

12 

1.6 

3 

3 

4 

4 

6 

7 

9 

1.8 

2 

3 

3 

4 

5 

5 

7 

2.0 

2 

2 

3 

3 

4 

4 

6 

3.0 

1 

1 

1 

2 

2 

2 

3 

If  we  must  estimate  <r  from  our  sample,  and  use  Student’s  1,  add  3 to  the  tabulated  values  to  obtain  the  approximate 
required  sample  size.  (Ifwe  are  comparing  two  product  averages,  add  2 to  the  tabulated  values  to  obtain  the  required 
size  rf  each  sample.  For  this  case,  we  must  have  <r^  = <rg). 


a = .05 


1 0 
d 

.50 

.60 

.70 

.80 

.90 

.95 

.99 

■’  i 

271 

361 

471 

619 

857 

1083 

1578 

.2 

68 

91 

118 

155 

215 

271 

395 

.4 

17 

23 

30 

39 

54 

68 

99 

.6 

8 

11 

14 

18 

24 

31 

44 

.8 

5 

6 

8 

10 

14 

17 

25 

1.0 

3 

4 

5 

7 

9 

11 

16 

1.2 

2 

3 

4 

5 

6 

8 

11 

1.4 

2 

2 

3 

4 

5 

6 

9 

1.6 

2 

2 

2 

3 

4 

5 

7 

1.8 

1 

2 

2 

2 

3 

4 

5 

2.0 

1 

1 

2 

2 

3 

3 

4 

3.0 

1 

1 

1 

1 

1 

2 

2 

If  we  must  estimate  <r  from  our  sample,  and  use  Student  I add  2 to  the  tabulated  values  to  obtain  the  approximate 
required  sample  size.  (If  we  are  comparing  two  product  averages,  add  1 to  the  tabulated  values  to  obtain  the  required 
size  of  each  sample.  For  this  case,  we  must  have  <r  ^ 
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TABLE  2-27 

PERCENTILES  OF  THE  STUDENT  t-DISTRIBUTION‘« 


The  body  of  the  table  gives  the  Cdf. 


V 

^.eo 

^.70 

^.80 

B 

IB 

t.vi 

t.Ki 

1 

0.325 

0.727 

1.376 

3.078 

6.314 

12.706 

31.821 

6.3.6.57 

2 

.289 

,617 

1.061 

1.886 

2.920 

4 , 30.3 

6 . 965 

9.925 

3 

.I'll 

,584 

0.978 

1.638 

2.353 

3.182 

4.541 

5.841 

4 

.271 

.569 

,941 

1.533 

2.132 

2.776 

3.747 

4.604 

5 

.267 

.559 

.920 

1.476 

2.015 

2.571 

3.365 

4.032 

6 

.265 

.553 

.906 

1.440 

1.943 

2.447 

3.143 

3.707 

7 

.263 

.549 

.896 

1.415 

1.895 

2.365 

2.9’38 

3.499 

8 

,262 

.S16 

.889 

1.397 

1.860 

2.306 

2.896 

3.355 

9 

.261 

.543 

.883 

1.383 

1.833 

2.262 

2.821 

3.250 

10 

.260 

,542 

.879 

1.372 

1.812 

2.228 

2.764 

3.163 

11 

.260 

.540 

.876 

1.363 

1.796 

2.201 

2.718 

3.106 

12 

.259 

.539 

.873 

1.356 

1.782 

2.179 

2.681 

3.055 

13 

,259 

.538 

.870 

1.350 

1.771 

2.160 

2.650 

3.012 

14 

.258 

.537 

.868 

1.345 

1.761 

2.145 

2.624 

2.977 

15 

.258 

.536 

.866 

1.341 

1.753 

2.131 

2.602 

2.947 

16 

.258 

.535 

.865 

1.337 

1.746 

2.120 

2.583 

2.921 

17 

,257 

.534 

.863 

1.333 

1.740 

2.110 

2.567 

2.898 

18 

.257 

.534 

.862 

1.330 

1.734 

2.101 

2.552 

2.878 

19 

.257 

,533 

.861 

1.328 

1.729 

2.093 

2.539 

2.861 

20 

.257 

.533 

.860 

1.325 

1.725 

2.086 

2,528- 

2.845 

21 

.2.57 

.532 

.859 

1.323 

1.721 

2.080 

2.518 

2.831 

22 

.256 

.532 

.858 

1.321 

1.717 

2.074 

2.508 

2.819 

23 

.256 

.532 

,858 

1.319 

1.714 

2.069 

2.500 

2.807 

24 

,256 

. .531 

.857 

1.318 

1.711 

2.064 

2.492 

2.797 

25 

.256 

,531 

.856 

1.316 

1.708 

2.060 

2.485 

2.787 

26 

.256 

.531 

.856 

1.315 

1,706 

2.056 

2.479 

2.779 

27 

.256 

.531 

.855 

1.314 

1.703 

2.052 

2.473 

2.771 

28 

.2.56 

.530, 

,855 

1.313 

1.701 

2.048 

2.467 

2.763 

29 

.256 

.530 

.854 

1.311 

1.699 

2.045 

2.462 

2.756 

30 

.2.56 

.530 

,854 

1.310 

1.697 

2.042 

2.457 

2.750 

40 

.255 

..529 

.851 

1.303 

1.684 

2.021 

2.423 

2.704 

60 

.251 

.527 

.848 

1.296 

1.671 

2.000 

2.390 

2.660 

120 

.2.51 

. 52G 

.815 

1.289 

1.6,58 

1.980 

2.358 

2.617 

OC 

.253 

.524 

.8-12 

1.282 

1.645 

1.900 

2.320 

2 . 576 

The  table  in  Ref.  18  was  extracted  from  a larger  one  in  Ref.  21. 


2-1 08 


AMCP  708-198 


2-11  ACCEPT/REJECTTESTS-NON- 
PARAMETRIC 

Nonparametric  tests  can  be  used  to  evalu- 
ate many  properties  of  a distribution  or  to 
make  comparisons.  Ref  25.  The  tests  in 
this  paragraph  deal  with  the  following  kind 
of  experiment  (Refs.  16  and  25).  A sample 
of  N items  is  life  tested  in  the  usual  (u) 
environment.  Times  to  failure  are  noted.  A 
similar  set  of  N items  is  simultaneously  sub- 
jected to  a more  severe  (s)  environment. 

The  statistical  analysis  determines  if  exposure 
to  “s”  changes  the  life  of  the  units  in  a 
s-significant  sense. 

The  null  hypothesis  (no  difference  in  the 
quality  that  the  statistical  test  measures)  is 
tested  against  the  alternative  that  there  is  a 
difference.  Engineers  need  not  concern 
themselves  about  the  technical  details  of  such 
hypotheses. 

Three  test  procedures  will  be  described  in 
these  paragraphs:  (1)  rank-sum,  (2)  run, 

(3)  maximum-deviation- Example  Nos.  16, 

17,  18,  and  19.  They  will  be  described  for 
the  same  basic  set  of  data.  The  successful 
application  of  these  tests  depends  on  the 
fact  that  life-test  data  can  be  put  in  time 
order. 

2-11.1  RANK-SUM 

Also  known  as  the  Mann- Whitney  or 
Wilcoxon  test.  See  Sec.  5.3,  Ref  25,  and 
Example  No.  17. 

2-11.2  RUNS 

Also  known  as  the  Wald-Wolfowitz  test. 

See  Ref.  1 6 or  Sec.  7.3  of  Ref.  25,  and  Ex- 
ample No.  18. 

If  the  smaller  of  the  rank  sums  is  greater 
than  the  critical  number  in  the  body  of  the 
table,  accept  the  null  hypothesis  that  the 
chances  are  50%— 50%that  any  unit  from 
one  population  will  have  a shorter  life  than 


any  unit  from  the  other  population. 

Both  the  rank-sum  test  and  the  run  test 
require  waiting  for  all  items  in  both  samples 
to  fail.  The  next  test  permits  test  truncation 
and  a shorter  test  time. 

2-11.3  MAXIMUM-DEVIATION 

The  maximum -deviation  test  is  a truncated 
test  (Ref  16).  In  this  test,  a value  is  pre- 
assigned to  r,  where  r refers  to  the  rth  order 
statistic.  For  example,  r - 2.  Then  examine 
the  data  to  establish  the  time  (either  or 

) at  which  at  least  two  failures  have  oc- 
curred in  both  samples.  From  the  test  data, 
the  time  corresponding  to  r = 2 is  “ 7.5, 
at  which  time  two  failures  have  occurred  in 
the  “usual”  sample  and  three  failures  have 
occurred  in  the  “severe”  sample. 

Define  a quantity  as  the  absolute  dif- 
ference betw'een  the  number  of  failures  in 
the  u and  5 samples  calculated  after  each 
failure.  Two  other  required  parameters,  m, 
and  Pf,  are  tabulated  in  Table  2-32  for 
r = 1,  3,  6,  10,  and  for  samples  of  size  10. 
(An  expanded  version  of  this  table  is  avail- 
able in  Ref  16.)  For  any  r,  — max  s, 

Proceed  as  follows.  If  M,,  = m,  + 1 at  any 
time  up  to  and  including  stop  the  test 
and  reject  Hq.  If  Af,.  < (la,—  1)  up  to  and 
including  t,.,  accept  Hq.  If  the  test  is  con- 
tinued tot,.,  and  = m,  at  least  once  and 
otherwise  Af,  < (la,—  1),  perform  a 
Bernoulli  trial  which  will  reject  Hq  with 
probability  p^-  See  Example  No.  19. 

2-12  SYSTEM  RELIABILITY  ESTIMATION 
FROM  SUBSYSTEM  DATA 

Many  weapon  systems  are  extremely  com- 
plex and  consist  of  large  numbers  of  sub- 
systems and  components.  During  a consider- 
able portion  of  the  system  development 
cycle,  only  component  and  subsystem  failure 
data  are  available  for  reliability  analyses.  The 
amount  of  data  often  varies  considerably 
[text  continues  on  page  2-114.] 
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Example  No.  16  (Ref.  14) 

The  fire  control  subsystem  of  a tank  is  tested  to  determine  if  a high  vibration  en- 
vironment influences  the  life.  A “usual”  sample  and  “severe”  sample  cf  lOtimes- 
to-failure  each  are  obtained.  The  ordered  times-to-failure  are  recorded  in  hours; 
see  Table  2-28. 


TABLE  2-28 

LIFE  DATA,  FIRE  CONTROL  SYSTEM 

(A)  Usual  environment  (N  = 10)  (B)  Severe  environment  (AT  = 10) 


4.0 

12.8 

1.0 

9.5 

.7.5 

13.0 

3.5 

15.0 

8.0 

14.0 

6.5 

19.5 

9.0 

21.5 

8.5 

28.0 

11.5 

27.5 

8.9 

31.1 

These  data  can  be  combined  into  an  ordered  array  of  20,  but  with  their  identity  noted 
(see  Table  2-29) . 

TABLE  2-29 


COMBINED,  IDENTIFIED  DATA 


L OS 

a Ou 

11. 5u 

19.55 

3.5s 

8.5s 

12.  8u 

21. 5u 

4.  Ou 

8.9s 

13.  Ou 

27. 5u 

6.5s 

9.  Ou 

14.  Ou 

28.  Os 

7.5u 

9.5s 

15.  Os 

31.15 
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Example  No.  17 


Procedure 

1.  Assign  the  ranks  1,  2,  20  1. 

to  the  ordered  sample  cf  twenty, 
i.  e.,  the  sample  1.0  is  labelled 
1 and  the  sample  31.1  is  labelled 

20, 


2.  Identify  the  ranks  of  sample  u.  2, 

3.  Identify  the  ranks  of  sample  s.  3. 

4.  Compute  the  sum  cf  the  ranks  of  4. 
sample  u. 

5.  Compute  the  sum  of  the  ranks  of  5. 
sample  s. 

6.  From  Table  2-30,  find  the  criti-  6. 
cal  rank-sum  s-significance 
number  C . 

1.  Test  the  null  hypothesis.  7. 


Example 


Sample 

Rank 

Sample 

Rank 

1.  os 

1 

11. 5u 

11 

3.5s 

2 

12.  8u 

12 

4.  Or 

3 

13.  Or 

13 

6.5s 

4 

14.  Or 

14 

7.5u 

5 

15.  Q 

15 

8.Qi 

6 

19.5s 

16 

8.5s 

7 

21, 5u 

17 

8.9e 

8 

27,  5u 

18 

9.  ou 

9 

28.  Os 

19 

9.5s 

10 

31.1s 

20 

3,  5,  6,  9,  11,  12,  13,  14,  17,  18. 
1,  2,  4,  7,  8,  10,  15,  16,  19,  20. 
Zrank,  = 108. 


Zrank,  = 102. 


From  Table  2-30,  for  an  original  sample 
sizeN  = 10  and  s-significance  level  = 5%. 

C = 79. 

Since  the  smaller  rank  sum,  Srankug  = 102, 
is  larger  than  C = 79,  accept  the  hypoth- 
esis stated  in  Table  2-30. 


Thus,  on  the  basis  of  this  test,  we  presume  that  a random  item  from  one  population 
is  equally  likely  to  last  longer  or  shorter  than  a random  item  from  the  other  popula- 
tion. 
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Example  No.  1 8 


Procedure 

1.  Tabulate  the  full  ordered  sample  of 
20  and  mark  each  item  with  a u if  it 
came  from  the  u sample  and  an  s if 
it  came  from  the  s sample. 

2.  A succession  cf  u’s  or  s’s  is  called 
a run  (a  single  u or  s is  a run  cf 
one).  Count  the  runs. 

3.  Enter  Table  2-31  to  determine  an 
acceptance  number^  and  a rejec- 
tion number  R for  s-significance 
level  = 5%. 

4.  Determine  the  validity  of  the  hy- 
pothesis. 


Example 

1.  See  Table  2-29. 


2.  2 runs  = 11, 

3.  From  Table  2 3 1 for  N = 10, 

A = 8 

R =6. 

4.  Since  Sruns  = 11,  and  11  > 8,  accept 
the  null  hypothesis  that  the  two  Cdf’s 
are  the  same. 
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Example  No.  1 9 


Procedure 


Example 


1.  For  r = 1,  determine  mi  and  si-  1. 


2.  Find  fi  s max{Mi,  si|.  2. 

3;  Define M,.  as  the  absolute  differ- 
ence  between  the  number  of  fail- 
ures in  the  u and  s samples  com- 
puted after  each  failure  occurs. 
Compute  this  F4  until  the  first 
failure  occurs  in  both  u and  s. 

4.  Determine  m,  .from  Table  2-32.  4. 

s-significance  level  =5%. 

5.  Evaluate  the  inequality.  5. 

If  < (in,  r 1),  accept  Hq- 

6.  Repeat  for  r = 3.  Fory  = 3,  6. 

determine  u,.  and  s>. 

7.  Find  = max{Mg,  S3}  7. 

8.  Compute  until  the  third  tail-  8. 
ure  occurs  in  both  u and  s. 


9,  Determine  ny. from  Table  2-32  9. 

at  5% s-significance  level. 

10.  Evaluate  the  inequality  10. 

If  IVb  < ~ accept  T/q. 


Ml  - 4. 0 

Si  = 1.0. 

h =4,0. 

For  r = 1,  after  first  failure,  M,.  = 1 
after  second  failure,  =2 
after  third  failure,  = 1. 

Stop  here  because  failure  in  m = failure 

in  s. 

r = 1,  mi  =4. 

1<  (4  -1)  = 3, 

Therefore  we  accept  the  hypothesis  TIq 
the  5%s-significance  level. 

M3  = 8.0 

S3  = 6.5. 

tg  = 8.0. 

For  r =3,  after  first  failure,  M,.  = 1 
after  second  failure,  M^=2 
after  third  failure,  M^=  \ 
after  fourth  failure,  IVb  = 2 
after  fifth  failure,  M,.  = \ 
after  sixth  failure,  M,.  = 0. 

r = 3 
mg  = 5. 

3 < (5  - 1)  = 4 

Therefore  we  accept  the  hypothesis  H(^  at 
the  5%level  of  s-significance. 
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TABLE  2-30*  TABLE  2-31* 

RANK-SUM  TEST  RUN-TEST  s-SIGNIFICANCE  CRITERIA'  ® 

s-SIGN IFICANCE  CRITERIA'* 

s-Significance  Level  = 5% 


sSignificance  level 


R 

A 

D 

N 

0.05 

0.02 

0.01 

n 

(reject  Hq 

if  (accept /Vq  if 

18 

16 

15 

^runs>A) 

issue  is  in  doubt) 

5 

6 

27 

24 

23 

5 

3 

4 

7 

37 

34 

32 

6 

3 

4 

8 

49 

46 

43 

7 

4 

5 

9 

63 

59 

56 

8 

5 

6 

10 

79 

74 

71 

9 

6 

7 

11 

97 

91 

87 

10 

6 

8 

7 {Ho  disfavored) 

12 

116 

110 

105 

11 

7 

9 

8 {Ho  favored) 

13 

137 

130 

125 

12 

8 

10 

9 {Ho  favored) 

14 

160 

152 

147 

13 

9 

11 

^0{Ho  favored) 

15 

185 

176 

170 

14 

9 

11 

10  (Wo  disfavored) 

16 

212 

202 

196 

15 

10 

12 

1 1 (Wo  disfavored) 

17 

241 

230 

223 

16 

11 

13 

12  (Wo  slightly  favored) 

18 

271 

259 

252 

20 

14 

16 

15  (Wo  disfavored) 

19 

303 

291 

282 

20 

338 

324 

315 

H 

5 = null  hypothesis  = there  is  no  difference  in  the  Cdf's  of  the 

2 variables. 

N 

= number  of 

items  in  each  sampie. 

"Reprinted  from  Mathematical  Methods  in  Reliability  Engineering  with  permission  of  McGraw-Hiii  Book  Company,  inc. 


from  subsystem  to  subsystem,  depending  on 
their  availability  for  testing  and  the  amount 
of  previous  experience  with  similar  items. 
Techniques  have  been  developed  for  estimat- 
ing system  reliability  based  on  subsystem, 
equipment,  and  component  reliability  data. 

Of  course,  estimating  system  reliability 
from  lower  level  data  can  never  be  as  accurate 
as  direct  testing  of  the  assembled  sy  stem. 
However,  these  estimates  are  very  useful  for 
decision  making  before  completed  systems 
are  available  for  testing. 

2-12.1  ADVANTAGES  OF  MODEL 

This  paragraph  describes  a statistical  model 
that  can  be  used  by  contractors  for  reliability 
estimation  and  by  the  Army  for  weapon- 
system  reliability-monitoring.  The  model 
permits  the  combination  of  test  data  from 
all  levels  (from  component  to  weapon  sys- 


tem) and  all  types  of  tests  into  meaningful 
component,  equipment,  and  subsystem  fail- 
ure rates  and  reliability'  predictions.  The 
failure  rates  and  reliability  estimates  can  be 
updated  continuously  as  new  test  data  be- 
come available. 

TABLE  2-32 

MAXIMUM-DEVIATION- 
TEST  s-SIGNIFICANCE 
CRITERIA'  * 

5%  s-Significance  Level 
Sample  size:  /V  = 10 

f Pr 

1 4 0.32 

3 5 0.17 

6 6 0.95 

10  6 0.95 
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The  information  required  for  the  use  of 
this  statistical  model  is  listed  here: 

1.  Detailed  analysis  of  the  mission  profile 
to  determine  stress  levels  and  durations  for 
each  hardware  level  and  to  convert  actual 
test  time  to  mission  equivalents. 

2.  The  subsystem  (or  system)  reliability 
equation. 

3.  Test  data,  including  total  test  times  and 
associated  environmental  stresses  and  failures 
from  all  test  sources. 

The  model  permits  reliability  assessment 
to  begin  on  a piecemeal  basis  with  informa- 
tion derived  from  development  tests,  engi- 
neering evaluation  tests,  and  from  qualifica- 
tion tests.  Later  on,  information  from 
production  tests  also  can  be  used. 

The  tests  may  differ  with  respect  to  levels, 
conditions,  and  durations;  they  may  be 
applied  at  component,  equipment,  and  sub- 
system levels,  and  the  test  conditions  include 
a wide  variety  of  environmental  conditions; 
and  their  durations  may  differ  considerably. 

The  calculation  of  the  best  estimate  of 
component  failure  rate  in  a specific  environ- 
ment will  be  discussed  first.  Then  techniques 
for  incorporating  data  from  higher  level  tests 
(equipment  and  subsystem)  in  the  calculation 
of  component  failure  rates  will  be  presented. 
Once  the  basic  failure  rate  is  established, 
methods  are  developed  for  combining  these 
estimates  to  generate  the  best  estimate  of 
mission  reliability.  A procedure  for  estimat- 
ing the  uncertainty  of  these  estimates  also  is 
described. 

2-12.2  COMPONENT  MODEL 

Consider  components  in  a complex  system 
which  must  operate  successfully  over  a de- 
fined mission  (Ref.  33).  During  the  mission, 
the  Component  is  exposed  to  environmental 
stresses  of  different  degrees,  kinds,  and  dura- 


tions. The  components  must  perform  their 
assigned  functions  when  they  are  needed. 

The  probability  of  completing  these  func- 
tions satisfactorily  in  the  operating  environ- 
ment is  called  s -reliability.  The  total  time 
that  a specific  component  must  operate  may 
be  less  than  the  total  mission  time.  Reli- 
ability is,  therefore,  a function  of  the  environ- 
mental and  usage  stresses,  the  operating  and 
nonoperating  conditions,  the  part  reference- 
failure  rates,  and  the  time  duration  of  the 
environments  and  usage  stresses.  The  com- 
ponent reliability  model  is  based  on  the 
following  assumptions  (modified  from  Ref 
33): 

1.  Failure  rate  is  independent  of  time. 

2.  Part  failures  are  s-independent  of  each 
other. 

3.  Part  failure  rate  is  independent  of  the 
history  of  the  component. 

4.  A specific  assumption  must  be  made 
about  the  failure  rate  for  all  phases  of  the 
mission,  even  benign  subphases. 

5.  There  is  a great  deal  of  uncertainty  in 
the  estimation  process,  much  of  which  is 
related  to  the  suitability  of  the  model,  and 
the  remainder  is  due  to  statistical  uncertainty 
(calculated  presuming  the  model  is  perfect). 

6.  The  k-factor  approach  is  useful  for 
converting  failure  rates  from  one  set  of  con- 
ditions to  another,  especially  for  storage-like 
conditions. 

7.  Each  special  environment  can  be  repre- 
sented by  an  additive  term  onto  the  reference 
failure  rate.  The  size  of  the  term  is  j-indepen- 
dent  of  the  presen ne  of  other  terms.  It  is  as 
if  each  special  environment  aggravated  exactly 
one  sindependent  failure  mode  in  the  item. 

Due  to  Assumption  No.  5 there  is  little 
point  in  making  minor  statistical  refinements 
in  the  estimate.  For  example,  s-bias  in  the 
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estimate  of  failure  rate  is  of  little  concern, 
especially  since  lack-of-s-bias  is  preserv  ed 
only  in  linear  transformations.  If  6 is  an 
s-unbiased  estimate  of  “6  - 1/X”,  then  1/0 
is  a s-biased  estimate  of  X and  R exp  (— 1/0) 
is  a s-biased  estimate  of  survival  probability. 
Since  no  one  knows  which  function  “ought” 
to  be  s-unbiased,  s-bias  is  ignored. 

The  equation  for  estimating  the  failure  rate 
is  the  maximum  likelihood  equation 

% = r/T  (2-67) 

where 

X = estimated  failure  rate 
r = total  failures 
T = total  test  time 

If  the  mission  is  partitioned  into  phases  and 
subphases,  an  equivalent  failure  rate  for  the 
mission  can  be  developed,  if  desired,  by  a 
simple  averaging  process: 

~ (2—68) 

where 

a!  = mission  phase  or  subphase 

= implies  sum  over  all  phases  (sub- 
phases) of  a partitioned  mission 

0 = fraction  of  mission  time  spent  in  a 

= failure  rate  while  in  a! 

The  coefficient  of  variation  of  X is  (for  large 
r) 


= l//m  (2-69) 

For  small  r,  the  formula  is  not  accurate  and 
there  is  no  simple  rigorous  formula.  Eq.  2-69 
is  well  v/ithin  the  limitations  of  Assumption 
No.  5.  The  choice  of  modification  for  small 
r depends  on  lots  of  things;  it  is  hard  to 
fault  any  approach  with  even  a modicum  of 
reason  to  it.  The  +1  with  the  r merely 
keeps  the  equation  from  “blowing  up”  at 
r = 0. 

In  complicated  equations,  it  is  usually 
sufficient  to  estimate  the  standard-deviation 
or  coefficient-of-variation  of  a function.  If 
s-confidence  limits  are  desired,  when  using 
Eq.  2-67,  there  are  no  exact  ways  to  get 
them  because  (a)  there  is  a lack  of  knowdedge 
about  the  details  of  the  tests  and  (b)  the 
method  of  combining  data  causes  difficulties. 
See  pars.  2-3.2  and  2-3.3  for  details. 

Example  Nos.  20  and  21  illustrate  this 
statistical  model. 

2-12.3  SYSTEM  MODEL 

For  series  systems,  the  system  failure  rate 
is  a linear  function  of  the  component  failure 
rates.  For  linear  functions  with  s-independent 
variables,  the  mean  of  the  function  is  the 
function  of  the  means  and  the  variance  of  the 
function  is  the  function  of  the  variances.  For 
more  complicated  systems,  see  Part  Two, 
Design  &n:  Reliability  the  paragraph  on  Para- 
meter Variations  Analysis. 

For  further  discussion  cf  this  and  similar 
models,  see  Refs.  33-35,  but  treat  any  pro- 
cedure with  skepticism  that  seems  to  violate 
Assumption  No.  5 (uncertainty)  or  pushes 
Assumption  No.  7 (additive  failure  rates  for 
environments)  too  far. 
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Example  No.  20 

Three  components  are  tested:  No.  Iwas  censored  after  3 hr;  No.  2 was  censored 
after  6 hr;  No.  3 failed  in  1 hr;  i.  e.,  r = 1.  The  parts  undergo  the  test  conditions 
during  15%  cf  the  mission  and  are  in  benign  circumstances  otherwise.  Determine  the 
equivalent  failure  rate  for  the  mission. 

Procedure  Example 


1. 

State  the  failure  rate  as- 

1. 

During  operating  phase,  the  failure  rate  is  the 

sumption  for  all  phases  cf 

same  as  on  the  test.  During  benign  phase,  it 

mission. 

is  assumed  to  be  5%  of  the  “operating”  value. 

2, 

Estimate  the  “operating” 

2. 

=1/(3  + 6 +l)-hr 

failure  rate.  Use  Eq.  2-67. 

= 0.1  per  hr. 

3. 

Estimate  the  “benign”  fail- 

3. 

ure  rate. 

= 0.005  per  hr. 

4, 

State  the  fraction  of  time  in 

4. 

4>ot>  -0.15 

each  phase. 

4’ben  — 0.  85, 

5. 

Calculate  the  equivalent 
mission  failure  rate.  Use 

5. 

hours  = 0.1  X 0.15  + 0.005  x 0.  85  = 0.019. 

Eq.  2-68. 

6. 

Estimate  the  coefficient  of 
variation  for  \p.  Use  Eq. 

6. 

=1/vT+1=0.71. 

''op 

2-69. 

The  estimates  of  failure  rates  for  a given  test  condition  can  be  updated  as  more 
test  data  become  available  from  component  level  testing.  Tests  conducted  at  higher 
levels  (such as  subsystem  or  equipment  tests)  which  are  monitored  for  failure  causes 
also  can  provide  data  for  updating  failure  rates.  These  data  must  indicate  the  actual 
time  that  each  component  operates  in  each  mission  phase  (subphase);  see  Example 
No,  21. 
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Example  No.  2 1 


One  type  cf  component  in  Example  No.  2U  is  operated  in  a subsystem  test  for  1 
hr  without  failure.  The  test  conditions  are  the  same  as  in  Example  No.  20,  and  the 
component  operates  all  the  time  the  subsystem  operates.  Reevaluate  the  equivalent 
failure  rate  for  the  mission. 


Procedure 

1.  State  the  old  cumulative  test -time 
and  failures  for  the  "operating" 
condition. 

2.  State  the  present  increments. 

3.  Calculate  the  new,  r,  T and 


4.  Estimate  the  coefficient  of  varia- 
tion for  A See  Example  No.  20, 
step  6. 

5.  Calculate  the  equivalent  mission 
failure  rate.  See  Example  No. 

20,  step  5. 


Example 

^old  ~ ~ 

2.  Ar  = 0,  AT  = 1. 

3-  = 1 + 0 = 1, 

'^new  - (10+  l)hr  = 11  hr 
\p  = 1/11  per  hr 
= 0.091  per  hr. 

4.  Since  r„g^  = r„i^,  tjj-  is  the  same  as  in 
Example  No.  20. 

5.  X hours  = 0.091  x 0.15 

+ 0.091  X 0.05  X 0.85  = 0.018. 
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CHAPTER  3 

STATISTICAL  EVALUATION  OF  RELIABILITY  TESTS,  DEMONSTRATIONS, 

AND  ACCEPTANCE 


LIST  OF  SYMBOLS 


a,  b 

parameters  of  accept  and 
reject  decision  lines,  see 
Eq.  3-11 

%■ 

- 

See  Eq.  3-36 

A,  R 

= 

subscripts:  A implies 
Accept,  R implies  Reject 

ARL 

= 

acceptable  reliability  level 

ASN 

= 

average  sample  number 

c 

= 

acceptance  number 

acceptance  number  for 
interval  i in  m-sample 
plans 

csqf  (x^ ; v) 

Cdf  of  the  chi-square 
distribution  with  v de- 
grees-of-freedom 

csqfc  (x" ; v) 

=: 

complement  of 
csqf  (x^ ; v) 

Cdf 

= 

Cumulative  distribution 
function 

d 

= 

number  of  defectives  so 
far  (in  a seq-sample  plan) 

d-of-b 

= 

degree  of  belief 

D 

— 

parameter  associated  with 
binomial  distribution, 
see  Eq.  3-10 

Ei 

- an  event 

h 

= parameter  of  accept  and 

reject  decision  lines. 

see  Eq.  3-12 

H 

= new  test  result 

H,  L 

= subscripts:  H implies 

Higher,  L implies  Lower 

Ho 

= null  hypothesis 

H, 

= alternate  hypothesis 

L,  U 

= subseripts:  L implies 

Lower,  U implies  Upper 

m-sample 

= a multiple-sample  plan 

n 

= number  of  items  tested 

so  far  (in  a seq-sample) 

plan 

N 

= sample  size 

= sample  size  for  interval  i 

in  multiplesample  plans 

OC 

= operating  characteristic 

pdf 

= probability  density 

function 

Pa 

= probability  of  acceptance 

3-1 


AMCP  706-198 


= probability'  of  event 
in  {•} 

r 

= number  of  failures 

= number  of  failures  for 
rejection 

R 

= s-reliability,  Sf 

R 

= s-unreliability,  i?  = 1 - 
a Cdf 

RL 

= reliability  level 

S,  Sj 

= slope  associated  with 
accept  and  reject  decision 
lines;  see  Eqs.  3-12  and 
3-28;  number  of  test 
stations 

s- 

implies  the  word 

“statistical(ly)”,  or 


implies  that  the  statisti- 
cal definition  is  intended 
rather  than  the  ordinary 
dictionary  definition 

seq-sample 

= a sequential-sample  plan 

Sf 

= Survivor  function, 

for  a continuous  variable 

T 

= total  test  time 

= value  of  T for  acceptance 

Tm 

= mission  time,  see  par. 
3-6.3 

URL 

= unacceptable  reliability 
level 

Wt 

= waiting  time  before  deci- 
sion, see  par.  3-6.3 

Z 

= a standard  s-normal 
variate,  oar.  3-8 

a 

= producer  risk 

0 

= consumer  risk 

1 

= discrimination  ratio 

e 

= 1/X,  exponential  scale 
parameter,  mean  of 
failure  time 

X 

= constant  failure  rate, 
Poisson  rate  parameter 

M 

= mean 

Xp ) V 

= value  of  chi-square  such 
that  csqfixpy,  v)  = P 

1.0 

= subscripts:  0 implies 
Hq  , 1 implies  Hy 

1 -sample 

= a single-sample  plan 

3-1  INTRODUCTION 


After  an  equipment  or  system  design  is 
well  established,  reliability-testing  changes 
from  a design  tool  to  a tool  for  making 
decisions  and  for  determining  if  reliability 
goals  have  been  met.  These  tests  range  from 
quality  assurance  tests,  which  are  performed 
at  the  parts  level  on  submitted  lots,  to  reli- 
ability demonstration  tests  at  the  system 
level  (Ref.  1). 

A test  program  that  produces  spurious 
results  can  lead  to  accepting  unreliable  equip- 
ment. The  cost  of  spare  parts  and  extra 
maintenance  can  far  exceed  the  cost  of 
accurate  testing.  Therefore,  a carefully  de- 
signed test  program  which  considers  s-con- 
fidence  levels,  sample  sizes,  consumer  and 
producer  risks,  and  test  cost  must  be  devel- 
oped. In  any  reliability  test,  many  engineer- 
ing factors  must  be  considered  in  addition 
to  statistical  factors. 

Often,  it  is  difficult  to  perform  a reliabil- 
ity demonstration  test  on  a complete  system, 
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especially  if  the  system  is  very  large.  For 
example,  it  would  be  almost  impossible  to 
perform  a reliability  demonstration  test  on 
a complete  ballistic  missile  system,  including 
missile,  launcher,  command  and  control,  etc. 
In  this  case,  techniques  which  permit  system 
reliability  (and  the  uncertainty  therein)  to 
be  estimated  from  subsystem  reliability  data 
can  be  used. 

3-2  CONCEPTS 

This  paragraph  treats  the  statistical  con- 
cepts for  tests  used  to  accept  or  reject  an 
equipment  or  system,  based  on  its  degree  of 
compliance  with  specified  reliability  goals. 

3-2.1  TERMINOLOGY 

The  statistical  basis  of  a decision  test 
(Accept/Reject)  is  the  theory'  of  testing  hy- 
potheses. In  reliability  testing,  the  null 
hypothesis  under  test  is:  “the  submitted 
lot  or  system  conforms  to  the  reliability 
requirement”.  An  alternate  hypothesis  is 
also  specified  (or  at  least  implied):  “the 
submitted  lot  or  system  does  not  conform 
to  the  reliability  requirement  in  some  way”. 
Rejecting  the  null  hypothesis  is  often  con- 
sidered statistically  equivalent  to  accepting 
the  alternate  hypothesis  (Refs.  1 and  5),  but 
other  engineering  considerations  often  apply. 

When  components  are  qualification  tested, 
samples -rather  than  whole  lots-are  used. 
Therefore,  the  possibility  of  incorrect  infer- 
ences due  to  sampling  fluctuations  has  to  be 
considered. 

The  following  notation  is  used: 

Hq  = the  null  hypothesis  that  the 

product  conforms  to  the  reliability 
requirements  (e.g.,  the  mean  life 
is  equal  to  a specified  value) 

Hi  — the  alternate  hypothesis  that  the 
reliability  cf  the  lot  is  at  some 


reliability  level  considered  to  be 
unacceptable. 

Incorrect  inferences  are  of  two  types: 

1.  Type  1 Error:  Hq  may  be  rejected 
when  it  is  true.  (Producer  risk) 

a = Probability  of  Type  1 error, 
producer  risk. 

2.  Type  II  Error:  Hq  may  be  accepted 
when  Hi  is  true.  (Consumer  risk) 

|3  = Probability  of  Type  11  error, 
consumer  risk. 

The  probabilities  of  making  these  errors  de- 
pend on  the  sample  size  and  decision  criteria. 
Table  3-1  summarizes  the  relationships. 

It  is  easy  to  get  boxed  in  by  statistical 
terminology  and  assertions.  For  example,  a 
valid  conclusion  of  some  statistical  tests  (not 
mentioned  so  far)  is  that  there  were  not 
enough  data  to  detect  a difference-if  it 
exists.  An  engineer  can  always  call  for  more 
tests.  It  may  mess  up  some  previously  cal- 
eulated  s-confidence  or  s-significance  levels, 
and  it  may  make  new  ones  virtually  impossi- 
ble to  calculate;  but  those  levels  are  not  the 
be-all  and  end-all  of  testing.  The  prime  pur- 
pose of  testing  is  to  be  sure  only  good  equip- 


TABLE  3-1 

RELATIONSHIPS  BETWEEN  TEST  DECISION 
AND  TRUE  SITUATION 


Test 

True  Situation 

Decision 

Hq  True 

Hi  True 

Accept 

Correct  Decision 

Type  II  Error 

Hq 

Probabiiity  = 1 — a 

Probability  = j3 

Accept 

Type  I Error 

Correct  Decision 

Hi 

Probabiiity  = a 

Probability  = 1 -j3 
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ment  gets  out  in  the  field;  don’t  lose  sight 
of  that  goal-even  at  the  expense  of  annoy- 
ing a statistician. 

In  acceptance  sampling,  the  probability  of 
a Type  1 error  a is  commonly  called  the 
producer  risk,  since  it  represents  the  risk  that 
a product  conforming  to  the  specification 
will  be  rejectf- ..  The  probability  of  a Type 
II  error  ^ is  o died  the  consumer  risk,  since  it 
represents  the  risk  of  accepting  a product 
that  ought  to  be  rejected  [(1  — P)  is  known 
as  the  power  of  the  test]. 

Reliability  can  be  measured  by  various 
parameters,  such  as  probability  of  suivival, 
mean  life,  and  failure  rate. 

The  following  nomenclature  is  employed: 

1.  Reliability  Level  (RL)  is  the  level  of 
the  reliability-measure  which  the  lot  or  sys- 
tem actually  has. 

2.  Acceptable  Reliability  Level  (ARL)  is 
the  RL  considered  to  be  acceptable,  and 
represents  the  null  hypothesis, 

i?o:  RL=ARL,  (3-1) 

(The  Acceptable  Quality  Level,  A gZ,,  is  the 
analogous  term  for  acceptance  tests  based  on 
fraction  defective.) 

3.  Unacceptable  Reliability  Level  (URL) 
is  the  RL  considered  to  be  unacceptable, 
and  represents  the  alternate  hypothesis, 

Fi:  RL  = URL  (3-2) 

(The  Lot-Tolerance-Percent-Defective  (LTED) 
is  the  analogous  term  for  acceptance  tests 
based  on  fraction  defective.) 

4.  Discrimination  Ratio  y is  a ratio  in- 
volving ARZ  and  URL,  and  always  is  defined 
so  that  it  is  greater  than  one. 


a.  For  mean-life  requirements, 

y = %/^x  (3-3) 

b.  For  failure-rate  requirements, 

T = Aj/Ao  (3-4) 

c.  For  survival-probability  requirements, 

y = RJRq  (3-5) 

where 

S = mean  life  (exponential  parameter) 

X = 1/0  = constant  failure  rate 

R = s-unreliability 

the  “0”  subscript  signifies  the  ARL 

the  “1”  subscript  signifies  the  URL 

The  ART  has  a hi^  probability  of  accep- 
tance and  the  URL  a low  probability  of 
acceptance.  It  is  important  that  specified 
values  of  the  ARL  and  URL  be  consistent 
with  operational  requirements.  Generally, 
the  URL  is  that  value  which  is  minimum  for 
satisfying  operational  requirements,  while 
the  ARL  is  a highly  acceptable  value;  the 
latest  revision  of  Ref  25  ought  to  be  con- 
sulted for  contractual  situations. 

This  method  of  describing  a sampling  plan 
can  be  very  misleading  to  a nonstatistician. 

It  is  probably  best  to  consider  this  procedure 
as  a means  of  picking  two  points  on  the 
Operating  Characteristic  (see  par.  3-2.4)  of 
the  sampling  plan,  in  order  to  generate  the 
complete  Operating  Characteristic.  Once  the 
entire  Operating  Characteristic  is  generated, 
one  can  forget  the  names  of  the  two  points 
used  to  generate  it. 

Many  pairs  of  points  will  lead  to  the  same 
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Operating  Characteristic,  even  though  the 
points  look  quite  different.  Once  the  entire 
Operating  Characteristic  has  been  generated, 
any  pair  of  points  which  he  on  the  Operating 
Characteristic  will  give  the  same  plan,  even 
though  the  ARL  and  URL  are  completely 
different. 

3-2.2  CONSUMER  AND  PRODUCER 
RISKS 

The  a and  risks  represent  the  specified 
decision  errors  associated  with  nominally 
good  and  bad  product,  respectively.  Since 
lower  risks  require  more  testing,  a balance 
between  the  amount  of  test  effort  and  the 
cost  of  a wrong  decision  is  required  (Ref.  1). 

In  general,  for  tests  in  the  development 
stage,  the  a and  risks  may  be  high,  say 
20%,  and  ought  to  be  low  for  subsequent 
tests,  such  as  production-acceptance  tests, 
say  5%  to  10%.  This  is  so  because  the  early 
tests  usually  are  scheduled  to  allow  later  de- 
sign changes,  and  the  user  at  this  point  is 
concerned  primarily  with  being  assured  that 
the  equipment  reliability  is  not  completely 
unacceptable. 

The  next  tests  are  those  scheduled  im- 
mediately after  the  first  production  run.  The 
a and  j3  risks  for  these  tests  are  usually  lower 
than  for  the  development  tests,  since  now 
the  equipment  design  is  complete  and  more 
equipments  are  available  for  test.  Risks  of 
10%  often  are  specified. 

The  third  phase  of  testing  is  a sampling 
during  production  to  ensure  that  acceptable 
quality  is  maintained.  If  the  producer  is 
continuously  meeting  the  reliability  goals, 
a limited  amount  of  testing  is  desired,  and 
the  a and  risks  can  be  higher  than  for  the 
initial  production  tests. 

3-2.3  s-CONFIDENCE  LEVELS 

Test  requirements  can  be  specified  in 


terms  of  s-confidence  levels.  Such  a spec- 
ification, however,  must  be  framed  carefully. 
The  specification  ought  to  depend  on  the 
operational  requirements  of  the  system  in 
which  the  components  are  located.  For  ex- 
ample, consider  the  following  specifications 
for  mean  life  8 : 

1.  Compute  the  90%  lower  s-confidence 
limit  . Since  one  can  be  90%s-confident 
that  the  true  mean  life  is  greater  than  Qi , 
if  8,  > 100  hr,  accept  the  lot;  otherwise, 
reject  it. 

2.  Compute  the  90%  upper  s-confidence 
limit  Bij.  Since  one  can  be  90%s-confident 
that  the  true  mean  life  is  less  than  if 

8,  < 100  hr,  reject  the  lot;  otherwise, 
accept  it. 

Specification  No.  1 is  equivalent  to  one  in 
which  the  consumer  risk  is  10%  at  a true 
mean-life  of  100  hr.  Specification  No.  2 is 
equivalent  to  one  in  which  the  producer 
risk  is  10%  at  a true  mean-life  of  100  hr. 

The  difference  between  the  two  tests  is 
apparent.  With  Specification  No.  1 , only 
10%of  lots  with  a mean  life  of  100  hr  will 
be  accepted;  while  with  Specification  No.  2, 
90%  of  the  lots  with  this  same  mean- life 
are  accepted. 

For  most  tests,  the  magnitude  of  a and 

and  the  number  of  test  observ  ations  N are 
related,  so  that  specifying  any  two  of  the 
quantities  determines  the  third.  One  ap- 
proach, for  nonsequential  tests,  is  to  specify 
a and  N and  to  choose  a test  which  mini- 
mizes p.  For  acceptance  testing,  the  trend 
now  is  to  specify  P instead  of  a.  If  it  is 
important  that  both  a and  P be  specified, 
the  sample  size  is  completely  determined. 
Because  iV  is  discrete,  the  exactly  chosen 
values  of  a and  P are  not  usually  attainable. 
The  a and  P are  then  moved  around,  for 
suitable  values  of  N,  until  an  acceptable  set 
is  found.  In  sequential  sampling,  a and  P 
are  specified  in  advance,  and  the  sample 
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size  is  a random  variable  whose  value  is  not 
predetermined  but  changes  in  successive 
tests;  see  pars.  3-5,  3-6,  and  3-7. 

Conventional  wisdom  gives  more  impor- 
tance to  the  2 special  points  (a/iRL)  and 
(P,  URL)  than  is  justified.  What  is  important 
is  the  entire  function  which  relates  true 
quality  to  accept  probability  over  the  entire 
range  of  possible  quality.  Ito.  3-2.4  explains 
this  function  and  its  uses. 


3-2.4  OPERATING  CHARACTERISTIC 
CURVE 

When  two  of  the  three  quantities -N,  a, 
and  )?-are  specified,  the  accept-reject  criterion 
rf  the  acceptance  test  uniquely  is  determined 
for  a given  family  of  tests.  It  is  then  pos- 
sible to  generate  the  Operating  Characteristic 
(OC)  curve  of  the  test  plan.  This  curve 
shows  the  probability  of  lot  acceptance  over 
all  possible  incoming  reliability  levels.  Two 
points  on  the  OC  curve  are  already  deter- 
mined-the  a and  P points  with  their  corre- 
sponding reliability  levels,  and  URL, 
respectively. 

For  example,  if  the  specification  is  in 
terms  of  a survival  probability'  for  a given 
period  of  time,  the  general  shape  of  the  OC 
curve  is  as  shown  in  Fig.  3-1. 

The  probability  of  acceptance  is  a binomial 
probability  parameter.  It  can  be  interpreted 
as  the  long-run  proportion  of  lots  that  will  be 
accepted.  If,  for  example,  the  OC  curve 
shows  that  a lot  with  a reliability  of  0.80 
will  be  accepted  with  a probability  of  65%, 
then  in  the  long  run  65%  of  all  lots  sub- 
mitted with  20%  defective  items  will  be 
accepted. 

Each  sampling  plan  has  its  own  OC  curve. 
This  entire  curve  is  affected  by  a change  in 
sampling  specifications. 


TRUES-RELIABILITY  OF  LOT 


Figure  3-  7.  Typical  Operating  Characteristic 
Curve  for  Reliability  Acceptance 
Test,  Hq.'  R=Rq,  Hj.-  R=Ri, 
Specified  a and  p (Ref  1} 


3-3  PRELIMINARIES  TO  TESTING 

Test  designers  must  consider  many  factors 
in  addition  to  statistical  ones.  These  engi- 
neering factors  include  test  environment, 
equipment,  and  test  procedures  which  must 
be  defined  in  advance  of  the  test  and  care- 
fully controlled  in  order  to  ensure  valid  test 
results  (Ref  2).  Several  areas  must  be  con- 
sidered for  a reliability  test  to  succeed  in 
providing  adequate  data: 

1.  Use  of  existing  information 

2.  Selection  of  test  parameters 

3.  Test  procedures  and  instructions. 


3-3.1  USING  EXISTING  INFORMATION 

When  designing  a test,  it  is  often  impos- 
sible to  include  all  possible  levels  of  impor- 
tant factors  influencing  reliability’.  For 
example,  if  the  three  environmental  factors- 
temperature,  vibration,  and  humidity  must 
be  considered  at  four  levels  each— 81  different 
combinations  would  have  to  be  generated  for 
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a full-factorial  design.  If  variations  in  input 
power,  frequency,  and  similar  factors  had  to 
be  generated,  the  total  number  of  combina- 
tions would  be  astronomically  hi^.  If 
historical  information  is  available  on  tests 
made  on  similar  equipments,  it  may  be  pos- 
sible to  eliminate  some  environmental  com- 
binations from  the  test.  A simple  example 
of  this  follows.  If  the  interaction  of  tem- 
perature and  vibration  has  been  shown  to 
be  a critical  factor  only  for  high  tempera- 
tures, then  combinations  of  temperature  and 
vibration  for  low  temperatures  can  be  ig- 
nored. 

Since  new  equipment  designs  usually  make 
use  of  many  standard  parts,  circuits,  and 
assemblies,  it  may  be  possible  to  use  pub- 
lished information  on  their  performance  and 
reliability  characteristics  to  reduce  the 
amount  of  reliability  testing  required.  These 
data  must  be  evaluated  carefully.  A check- 
list of  factors  to  consider  in  evaluating  such 
data  is  given  in  Table  3-2.  This  list  is  to  be 
used  together  with  the  engineer's  knowledge 
of  the  system  to  determine  how  the  existing 
data  can  be  used.  But  remember,  engineers 
tend  to  be  overly  optimistic  about  their 
designs. 

The  number  of  environmental  combina- 
tions which  must  be  applied  to  a system 
during  reliability  or  to  its  components  dur- 
ing qualification  testing  depends  on  how 
much  information  can  be  derived  from  reli- 
ability tests  performed  during  research  and 
development.  These  tests  provide  data  that 
substantially  reduce  the  number  of  com- 
binations of  environmental  and  other  factors 
which  must  be  considered  in  later  testing. 

3-3.2  SELECTION  OF  TEST  PARAMETERS 

The  reliability  parameters  which  are 
measured  by  a test  are  usually  those  which 
have  been  specified  in  the  original  contract 
and  specifications  (Refs.  1 and  2).  Param- 
eters such  as  Mean  Life,  MTBF,  Reliability 


with  Repair,  and  Availability,  are  specified 
as  system  measures  of  effectiveness.  Usually, 
the  system  specification  states  that  the  sys- 
tem must  meet  some  minimum  level  of  a 
parameter  at  a specified  s-confidence  level. 

For  example,  the  specification  might  state 
that  the  system  must  meet  a 1200  hr  mini- 
mum MTBF  with'a  90% s-confidence  level. 
Various  measures  can  be  selected,  depending 
on  the  system  design,  performance  charac- 
teristics, and  mission. 

There  are  no  formal  rules  for  selecting  the 
measures  to  be  tested.  Engineers  and  con- 
tracting officers  must  use  their  best  judgment 
based  on  their  experience  when  specifying 
test  parameters.  Considerable  care  must  be 
devoted  to  the  selection  of  parameters  to  be 
measured  on  the  test  because  the  types  of 
test  rigs,  test  equipment,  and  procedures  to 
be  used  depend  on  the  parameters  tested.  If 
the  proposed  test  is  too  severe  and  expensive. 


TABLE  3-2 

BASIC  CHECKLIST  FOR  DATA  REVIEW 

1 . What  E the  source  of  the  data? 

2.  When  and  where  were  the  data  obtained? 

3.  What  was  the  purpose  of  the  experiment? 

4.  Concerning  which  population  can  conclusions 
be  drawn? 

5.  What  was  the  experimental  design? 

6 . H ow  were  sample  items  selected? 

7 . What  were  the  operating  and  environmental 
conditions? 

8.  If  failure  rates  are  given,  how  was  failure 
defined? 

9.  If  repair  rates  are  given,  under  what  conditions 
were  repairs  made? 

ID  Is  there  any  measure  of  experimental  error? 

11.  What  was  the  basis  for  computingtime? 

1 2.  What  type  of  test  instrumentation  was  em- 
ployed? 

1 3.  What  are  the  major  differences  between  items 
tested  and  those  under  consideration? 

14.  How  do  the  results  compare  with  those  of 
similar  investigations? 
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it  may  be  deleted  by  a contract  modification 
when  calendar  time  and  funds  begin  to  run 
low. 

3-3.3  TEST  PROCEDURES 

A detailed  set  of  test  procedures  must  be 
developed  for  quality  assurance  tests  and  reli- 
-ability  demonstration  tests  (Refs.  1 and  2). 
The  procedures  are  a crucial  part  of  the  test 
and  must  be  carefully  designed.  The  test 
procedures  ought  to  include  the  following: 

1.  Purpose  of  test 

2.  Test  items-description  and  sample 
selection 

3.  Test  monitoring  and  review  procedures 

4.  Test  equipment  required 

5.  Test  equipment  calibration  procedures 

6.  Test  equipment  proofing 

7.  Environmental  conditions  to  be 
applied 

8.  Operating  conditions 

9.  Test-point  identification 

10.  Definition  of  limits  of  satisfactory 
performance 

11.  Procedures  for  conducting  test 

12.  Test  report  procedures  and  docu- 
ments. 

3-4  EXPERIMENTAL  DESIGN 

Reliability  testing  usually  is  performed  on 
a small  sample  of  items.  Based  on  the  test 
results,  inferences  are  made  about  the  popula- 
tion from  which  the  sample  was  drawn.  Prin- 


ciples of  experimental  design  have  been  de- 
veloped so  that  valid  inferences  can  be  drawn. 
These  principles  are  briefly  discussed  in  this 
paragraph  (Refs.  14). 


34.1  THE  POPULATION 

In  experimental  design,  the  population  is 
the  set  of  objects  about  which  inferences  are 
to  be  drawn  (Ref.  1).  Usually  the  popula- 
tion is  an  actual  rather  than  an  abstract 
group.  In  equipment  reliability  testing,  how- 
ever, inferences  must  be  made  about  items 
not  actually  in  existence  at  the  time  of  the 
test,  but  which  will  be  produced  at  some 
time  in  the  future.  For  example,  when  a 
demonstration  test  is  to  be  performed  on  a 
complex  equipment,  only  three  or  four  of 
the  equipments  may  actually  exist  and  only 
one  or  two  may  be  used  for  the  test.  It  is 
assumed  that  if  the  equipments  are  manufac- 
tured under  the  same  production  processes 
at  a future  time,  then  reliability  inferences 
based  on  tests  of  small  numbers  of  equip 
ments  are  valid.  If  a major  redesign  or 
retrofit  takes  place  as  a result  of  field  ex- 
perience, the  results  of  previous  tests  may 
not  be  valid  and  additional  testing  may  be 
required . 

There  are  no  formal  rules  for  dealing  with 
the  problem  of  population  definition,  except 
that  it  is  necessary  to  define  as  completely 
as  possible  the  equipment  test  procedures 
and  test  conditions  from  which  inferences  are 
to  be  made. 

The  method  of  drawing  the  random  sample 
determines  the  population  about  which  in- 
ferences are  to  be  made.  Ask  the  question: 
“From  what  population  is  my  sample  a tmly 
random  sample?”  Generally,  the  population 
about  which  inferences  legitimately  can  be 
made  is  much  more  restricted  than  the 
engineer  would  like.  This  consideration  is 
extremely  important  in  evaluating  much  of 
the  theoretical/empirical  research  in  reliability. 
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3-4.2  ELIMINATION  OF  BIAS 

Bias  in  a reliability  test  may  result  in 
false  conclusions.  Bias  may  arise  through 
the  choice  of  sample,  experimenter  influences, 
instrument  errors,  physical  or  laboratory 
variations,  or  the  experimental  design  itself 
Bias  can  be  reduced  through  experimental 
controls  and  randomization  (Ref  1). 

34.2.1  Experimental  Controls 

In  part  qualification  tests,  parts  used  for 
control  are  selected  from  the  same  population 
as  the  test  sample  and  are  subjected  to  the 
same  conditions  with  the  exception  of  the 
conditions  that  are  being  studied  (Ref  1). 
Controls  permit  the  test  engineer  to  determine 
if  the  test  results  are  a function  of  the  con- 
ditions applied  or  of  other  variables  that  are 
biasing  the  results.  The  test  engineer  may  be 
interested,  for  example,  in  the  variation  of 
resistance  with  time  when  resistors  are  sub- 
jected to  a specific  set  of  operating  and  en- 
vironmental conditions.  If  control  resistors 
are  not  used,  the  engineer  cannot  be  sure  if 
observed  fluctuations  in  resistance  are  time 
fluctuations,  or  are  caused  by  the  load,  or 
are  due  to  a combination  of  time  and  load. 

A group  of  similar  resistors  that  did  not  have 
any  load  imposed  on  them  could  be  used  as 
a control. 

The  use  of  controls  is  more  difficult  to 
implement  on  reliability  demonstration  tests 
because  only  a limited  number  of  equipments 
or  systems  are  tested.  If  only  a few  systems 
are  available,  it  makes  more  sense  to  use 
them  for  demonstration  testing  rather  than 
to  waste  a system  as  a control. 

34.2.2  Randomization 

The  test  engineer  can  use  randomization 
procedures  to  protect  against  the  introduction 
of  bias.  An  example  of  a situation  in  which 
randomization  is  required  is  a life  test  experi- 
ment designed  to  test  the  effects  of  power 


dissipation  and  temperature  on  resistors 
(Ref.  1 ).  A group  of  resistors  is  to  be  placed 
in  an  oven  which  maintains  a constant  tem- 
perature. The  resistors  are  to  be  split  into 
three  groups,  each  with  a different  power 
dissipation.  If  there  are  three  racks  in  the 
oven,  the  simplest  procedure  is  to  place  each 
power  dissipation  group  on  a rack. 

During  the  life  test,  hot  spots  may  develop 
in  the  oven,  especially  since  different  levels 
of  power  dissipation  generate  different 
amounts  of  heat.  Also,  because  hot  air  rises, 
the  top  rack  could  be  somewhat  hotter  than 
the  bottom  rack.  Placement  of  all  resistors 
of  one  group  on  the  same  rack  might  lead  to 
biased  results.  To  avoid  this  possibility,  the 
oven  location  of  each  resistor  can  be  deter- 
mined in  a random  manner,  such  as  through 
the  use  of  a random-number  table.  Then  the 
unknowm  or  uncontrollable  effects  of  tem- 
perature variation  within  the  oven  would  be 
distributed  within  all  power  dissipation 
groups  (bias  is  converted  into  an  uncertainty 
which  good  statistical  analysis  can  estimate 
and  correct  for). 

In  reliability  demonstration  tests,  the  order 
and  combination  of  applied  stresses  and 
environments  can  be  determined  randomly 
if  they  are  not  otherwise  specified.  This  en- 
sures that  all  such  combinations  are  equally 
likely  on  the  test  and  that  no  biases  are 
introduced. 

3-4.3  EXPERIMENTAL  UNCERTAINTY 

Experimental  uncertainty  is  the  random 
effect  of  factors  over  which  the  experimenter 
does  not  have  complete  control  (Ref  1). 

Two  important  sources  of  experimental  un- 
certainty are  (1)  the  inherent  variability  in 
manufactured  parts,  and  (2)  the  random 
variation  in  the  physical  conduct  of  experi- 
ments. 

Experimental  uncertainty  is  associated 
with  the  concept  of  precision,  the  repeat- 


3-9 


AMCP  70S-198 


ability  of  results.  The  larger  the  experimental 
uncertainty,  the  less  precise  the  results.  The 
size  of  the  experimental  uncertainty  can  be 
decreased  through  replication  of  the  experi- 
ment. Replication  is  the  term  used  to  indi- 
cate the  number  of  parts  with  which  a 
specific  test  condition  is  associated.  The 
total  sample  size  is  the  sum  of  all  the  replica- 
tions. For  example,  if  a test  is  conducted  at 
A levels  of  temperature,  B levels  of  vibration, 
and  C levels  of  acceleration,  there  are  a total 
of  A’B‘C  combinations.  If  each  of  these 
combinations  has  R replications,  the  total 
number  of  parts  to  be  sampled  is  (A*B‘C)R. 
Increasing  the  number  of  replications  will  in- 
crease the  precision  of  the  test,  i.e.,  reduce 
the  experimental  uncertainty. 

A valid  test  must  provide  a good  estimate 
of  the  experimental  uncertainty.  Randomiza- 
tion provides  the  test  engineer  with  a tech- 
nique that  ensures  good  estimates  of  un- 
certainties. To  support  the  results  of  an 
experiment  with  probability  statements, 
randomization  is  necessary  in  the  sample 
selection  and  in  the  experimental  design. 

Standard  deviations  and  s-confidence  state- 
ments are  two  popular,  good  ways  of  meas- 
uring uncertainty. 

3-4.4  SAMPLE  SELECTION 

The  elimination  of  possible  sources  of  bias 
is  an  important  consideration  in  the  choice 
of  sample  items.  Before  a sample  selection 
scheme  is  chosen,  the  population  from  which 
the  sample  is  to  be  drawn  must  be  precisely 
and  correctly  defined.  If  resistors  are  the 
parts  under  consideration,  the  test  engineer 
must  ask  if  the  population  is  to  contain  all 
resistors,  or  just  carbon  composition;  all 
values  of  resistance;  S%,  10%,  or  20%  toler- 
ance limits;  and  so  on.  The  population  must 
be  precisely  and  correctly  defined,  since  con- 
clusions of  the  experiment  are  limited  to 
that  population  from  which  the  actual  sample 
is  truly  a random  one.  In  demonstration 


tests,  “identical”  systems  must  be  tested 
(Ref.  1). 

The  principal  requirement  of  any  sampling 
procedure  is  that  it  yield  representative 
samples.  A representative  sample  is  a min- 
iature of  the  population.  To  make  inferences 
about  the  population  from  the  sample  re- 
sults, the  sample  selection  must  be  random. 
The  simplest  kind  of  random  sample  results 
when  every  item  in  the  population  has  an 
equal  chance  of  being  chosen  for  the  sample. 
A simple  random  sample  does  not  necessarily 
result  in  a representative  sample.  Stratified 
sampling  can  be  used  to  obtain  a sample  that 
is  representative  of  the  universe  of  items  to 
be  tested.  However,  within  each  stratum, 
the  final  selection  procedure  is  random. 

In  system  demonstration  testing,  the  Sam- 
ple selection  is  limited  to  a few  systems. 
Often,  a random  sampling  procedure  cannot 
be  followed  because  the  testing  is  limited  to 
the  first  few  preproduction  models.  Then  it 
is  important  to  distinguish  between  the  spe- 
cial attention  preproduction  models  are  given 
(from  purchased  parts  to  final  inspection)  vs 
the  kind  of  actual  production  system  in  the 
future.  For  example,  how  will  the  quality 
of  incoming  steels  be  checked  to  be  sure 
they  meet  the  specifications,  month  after 
month?  What  will  long  term  variations  in 
all  kinds  of  properties  do  to  estimates  of 
standard  deviations  which  were  based  on  a 
few  samples? 

3-5  TYPES  OF  TESTS 

Tests  often  are  classified  as  “attributes”  or 
“variables”. 

An  attributes  test  is  one  in  which  each 
item  is  tested,  and  judged  to  be  a success  or 
a failure.  Attributes  tests  usually  are  used 
for  testing  a 1 -shot  item  in  which  time  or 
cycles  are  not  involved.  It  is  possible,  how- 
ever, to  include  time  by  testing  each  item 
for  a specified  period  and  counting  the  num- 
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ber  of  successful  and  failed  items.  This  type 
of  test  is  not  usually  called  a life  test,  be- 
cause the  time  at  which  the  failures  oceurred 
during  the  testing  period  is  not  considered. 

A variables  test  is  one  in  which  some 
characteristic  of  the  test  items  is  measured 
on  a continuous  scale,  such  as  amplitude, 
power  output,  or  life.  If  the  characteristie 
is  not  life,  and  if  each  item  is  tested  for  a 
specified  time,  the  characteristic  is  measured 
at  the  end  of  this  time. 

A life  test  is  a variables  test  in  whieh  the 
important,  measured  thing  is  the  time  it  takes 
an  item  to  reach  a particular  condition,  usu- 
ally a “failure”.  The  times  at  which  the  fail- 
ures occur  are  recorded. 

The  kind  of  test  which  should  be  used 
often  can  be  decided  by  evaluating  the  ap- 
plication of  the  item  and  its  reliability  ob- 
jective. If  the  reliability  objective  is  stated 
in  terms  of  probability  of  surviving  a fixed 
mission,  an  attributes  test  at  the  end  of  the 
mission  often  is  used.  If  the  goal  is  in  terms 
of  time  to  failure,  a life  test  usually  is 
indicated. 

When  more  than  one  type  of  test  could  be 
employed;  such  factors  as  type  of  informa- 
tion provided,  degree  of  protection  afforded, 
amount  and  cost  of  inspection,  and  ease  of 
administration  should  be  considered.  Table 
3-3  summarizes  the  conventional  wisdom  on 
advantages  and  disadvantages  of  each  type 
of  plan  with  respect  to  these  considerations. 

3-5.1  SINGLE-  OR  MULTIPLE-SAMPLE 
PLANS 

The  terminology  is  not  standard,  and  so  it 
will  be  explained  here.  All  samples  are  pre- 
sumed to  be  random  from  a large  lot. 

Single-sample  (1 -sample)  plans  test  one 
sample  of  items,  and  then  decide  to  accept 
or  reject  the  lot.  The  analysis  usually  is 
exact. 


Multiple-sample  (m-sample)  plans  can  test 
several  samples  of  items.  After  every  sample, 
except  the  last,  the  plan  decides  to  accept  or 
reject  the  lot,  or  to  take  another  sample. 

After  testing  the  last  sample,  the  plan  decides 
to  accept  or  reject  the  lot.  The  analysis 
usually  is  exact. 

Sequential-sample  (seq-sample)  plans  are, 
in  effect,  m-sample  plans  whose  boundaries 
have  been  drawn  differently.  Most  of  the 
analyses  are  very  approximate  and  deal  with 
untruncated  plans  (sample  size  °°).  Natur- 
ally, all  real  plans  are  somehow  truncated. 
Refs.  21  and  22  show  exact  analyses  of 
several  plans  and  give  references  to  exact 
analyses  of  other  plans. 

Fig.  3-2  is  a pictorial  description  of 
sampling  plans.  The  illustrations  are  all  for 
attributes  plans,  but  the  axes  can  be  relabeled 
for  variables  plans.  The  course  of  the  test 
can  be  represented  as  a path,  a series  of 
points,  wherein  the  cumulative  result  of  test- 
ing each  item  is  plotted.  When  the  path 
touches  or  crosses  a boundary,  the  decision 
appropriate  to  that  boundary  is  made.  Test- 
ing continues  until  a boundary  is  reached. 

Fig.  3-2(A)  is  the  traditional  1 -sample  plan. 
The  boundary  is  a rectangle.  The  slash  shows 
the  dividing  line  between  accept  and  reject; 
the  point  (A',c)  is  on  the  aceept  boundary; 
the  point  (N,  c + 1)  is  on  the  rejeet  bound- 
ary. 

Fig.  3-2(B)  is  the  traditional  2-sample  plan. 
The  point  (N,  +2^2;  Cj ) is  “aeeept”;  the 
point  (Aj  + A2,  C2  + 1)  is  “rejeet”.  A tra- 
ditional r-sample  plan  would  have  r such 
rectangles  put  one  on  top  of  the  other.  The 
aeeept  line  is  a series  of  steps;  the  reject  line 
is  horizontal  and  even  with  the  top  of  the 
last  step.  Very  seldom  is  r greater  than  2 
m a widely  used  plan,  and  almost  never  is  it 
greater  than  3. 

Fig.  3-2(C)  is  the  traditional  sequential- 
sample  plan.  The  shape  of  the  truncation  is 
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TABLE  3-3 

COMPARISONS  BETWEEN  ATTRIBUTES  AND  VARIABLES  TESTING 

Variables  Variables 


Factor 

Attributes 

(other  than  life) 

(Life  Test) 

Use  of  Item 

Single  operation. 

Single  operation. 

Repetitive  or  continuous  operation 
over  time. 

Type  of 

Information 

Yielded 

Number  or  fraction 
of  sample  that  failed 
to  meet  specified 
quality  character- 
istics at  a given 
point  in  time. 

Distribution  of  some  quan- 
titative output  at  a given 
point  in  time.  Provides 
most  information  for  qual- 
ity improvement. 

Distribution  of  failures  over  time. 

Reliability 

Goal 

Fraction-defective  or 
probability -of-sur- 
vival  over  a fixed 
time  period. 

Output  tolerance  limits 
which  define  success  or 
fai  lure  possibly  applying 
after  a fixed  period  of 
operation. 

Mean  life,  failure  rate,  or  probability 
of  survival  for  a fixed  time  period. 

Sample  Size 
for  Given 
Protection 

Usually  highest. 

Usually  lower  than  attributes 
test  for  corresponding  plan. 

Lower  than  attributes  test  for 
corresponding  plan. 

Ease  of 
Inspection 

Requires  relatively 
simple  test  equip- 
ment and  less- 
qualified  person- 
nel. 

More  complex  test  equip- 
ment and  better  trained 
people  required  than  for 
attributes  tests. 

Continuous  observation  necessary 
for  most  types  of  tests.  Highly 
trained  people  required.  Difficult 
to  maintain  controlled  test  con- 
ditions. 

Simplicity 

of 

Application 

Data  recording  and 
analysis  is  fairly 
simple.  Single  set  of 
attributes  criteria 
applies  to  all  quality 
characteristics. 

More  clerical  costs  than 
attribute  plans.  Vari- 
ables criteria  needed  for 
each  quality  character- 
istic. 

More  clerical  costs  than  attribute 
plans.  Has  one  set  of  criteria  for 
all  quality  characteristics. 

Statistical 

Considera- 

tions 

No  assumptions  on 
failure  distribution 
required.  Binomial 
distribution  applies 
for  most  cases.  Ex- 
tensive tables  are 
available.  (Refs. 
5-7) 

Often  requires  a parametric 
assumption  on  the  distribu- 
tion of  the  characteristic 
considered,  (Ref,  8) 

Usually  requires  an  assumption  of 
a time-to-failure  distribution. 
Tables  available  for  exponential 
and  Weibull  distributions.  (Refs. 
9 and  10) 

See  Rof.  19for  nonparametric  tests  and  Ref.  20  for  a general  discussionof  reliability  and  life  tests. 
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d = defectives  found  so  far 

n = number  tested  so  far 

c = acceptance  number 

A = "Accept"  regioit 

R = " Reject"  region 

The  dotted  line  is  r/  = A/  + 1 , and  is  unreachable. 

All  boundaries,  for  discrete  variables,  are  a series  of  points. 
The  d and  n scales  are  not  the  same. 


d I 


N,  A/,+A/, 

tA)  1 -sample  pian  (B)  2-sample  plan 


(C)  Seq-sample  plan, 
2-way  decision 


n 


(D)  Seq-sample  plan, 
3-way  decision 


Figure  3-2.  Various  Sampling  Plans 
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usually  optional,  and  either  the  horizontal 
or  vertical  segment  can  be  missing. 

Fig.  3-2(D)  is  an  unusual  sequential-sample 
plan;  it  has  3 decision  regions  on  the  bound- 
ary. For  example,  in  the  “worse”  region, 
one  might  reward  the  supplier.  In  the 
supplier  in  some  other  way.  In  the  “better” 
region,  one  might  reward  the  supplier.  In  the 
“OK”  region,  the  lot  would  be  accepted  but 
with  no  penalty  or  reward. 

For  each  plan,  the  OC  curve  can  be  de- 
rived (in  principle  anyway,  in  practice  it 
might  be  difficult,  expensive,  and/or  tedious). 
It  will  show  the  probability  of  a particular 
decision  vs  true  quality.  Also,  the  Average 
Sample  Number  (ASN)  can,  in  principle,  be 
derived  for  each  plan,  as  a function  of  true 
quality. 

It  is  easy  enough  to  estimate  the  actual 
quality  of  the  lot,  but  it  is  quite  difficult  to 
find  the  probability  distribution  of  that 
estimate  unless  the  sample  size  is  fixed.  In 
all  the  plans  shown  in  Fig.  3-2,  the  sample 
size  is  a random  variable  because  a decision 
can  (must)  be  made  any  time  a boundary  is 
touched  (this  is  called  curtailed-sampling). 
Since  this  chapter  deals  only  with  decision 
making,  not  estimation,  the  difficulties  in 
estimating  will  not  be  considered  further. 

There  is  no  rule  or  law  of  statistics  (or 
anything  else)  that  determines  what  shape 
the  decision  boundary  must  have.  Some 
shapes  may  be  better  than  others,  according 
to  specific  criteria,  but  no  shape  (or  implied 
plan)  is  always  better  in  all  ways  than  any 
other  plan. 

Two  examples  are  given  for  the  usual 
m-sample  plans.  Notation  follows: 

Cj  = acceptance  number,  i.e.,  if  cf  < c,- 
/ 

when  n = I,  N-  then  accept  the  lot. 

/■=  1 


If  d = + 1,  reject  the  lot.  Other- 

wise continue  sampling. 

Nj  = size  of  sample  / 

m = maximum  number  of  samples 

n = number  tested  so  far 

d = number  of  defectives  found  so  far 

1- sample  Plan 

N,  = 100, f,  = 3 

This  means  that  if  n = 100  and  d < 3, 
accept  the  lot,  if  d = 4,  reject  the  lot. 

Often  the  simplest  administrative  instructions 
are  presumed  to  be:  Test  the  whole  lot  of 
100;  if  “d  < 3”,  accept  the  lot,  otherwise 
reject  it. 

2- sample  Plan 

A,  = 100,  c,  = 3 

Aj  = 200,  C2=l 

This  means  that  if  n = 100  and  d < 3, 
accept  the  lot.  If  n = 100  and  3 < d < 7, 
take  a sample  of  200  more.  If  n = 100  + 

200  = 300,  and  d < 7,  accept  the  lot.  If  at 
any  time,  d > 1,  reject  the  lot.  As  in  the 
1 -sample  plan,  it  is  often  thought  to  be 
simpler  not  to  have  the  inspector  concern 
himself  about  the  number  of  defectives, 
except  at  n = A,  and  n =N,  + A2. 

In  the  seq-sample  plan,  it  is  usually  con- 
sidered that  a decision  of  some  sort  is  made 
after  testing  each  specimen.  In  practice  this 
need  not  be  true.  When  d is  discrete,  it  is 
possible  at  the  beginning  to  determine  the 
minimum  n (n  = n ,)  for  acceptance  (i.e., 
d = 0)  and  to  take  a sample  of  that  size. 

If  the  point  («j,  cf)is  within  bounds,  me 
minimum  “additional  sample  size  to  accept” 
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can  be  calculated,  and  a sample  of  that  size 
drawn.  This  process  is  repeated  until  a 
decision  boundary  is  reached. 

Conventional  wisdom  attributes  smallest 
sample  sizes  to  seq-sample  tests,  largest  sam- 
ple sizes  to  1-sample  tests,  and  in  between 
to  m-sample  tests.  However  it  is  diffieult  to 
compare  sample  sizes  because: 

1.  Sample  size  can  be  a random  variable; 
usually  then  one  deals  with  ASN. 

2.  The  OC  cuives  for  the  tests  that  are 
being  compared  are  not  (and  cannot  be) 
exactly  the  same  (see  pp.  261-262  of  Ref. 

23),  even  though  they  may  be  close  in  some 
regions  of  true  quality. 

3.  The  ASN  is  a function  of  true  quality. 

It  has  been  shown  (see  p-  262  of  Ref.  23) 
that  the  usual  seq-sample  test  of  Wald,  has 
an  ASN  no  larger  than  any  other  sample  plan 
at  the  2 true-quality  points  where  the  plans 
intersect  (often  these  2 points  will  be  the 
consumer  and  producer  risk  points). 

If  the  distribution  of  true-quality  of  in- 
coming lots  is  known  rather  well,  then  eon- 
suit  a statistician  to  optimize  the  sampling 
procedure  (of  eourse,  ehoosing  the  eriteria 
for  optimization  will  be  an  exeiting  task  in 
itself). 

Fig.  3-3  compares  the  ASN  for  several 
sampling  plans.  The  usual  proeedure  is  used 
for  the  1-sample  and  2-sample  plans  (i.e.,  d 
is  monitored  only  at  the  possible  aeeeptanee 
points).  In  Fig.  3-3  the  plans  are  asserted  to 
be  roughly  equivalent  to  the  1 -sample  plan 
of  A = 75,  c = 1. 

Table  3>A  compares  some  characteristies 
of  sampling  plans. 

3-5.2  TRUNCATION 

A truncated  life  test  is  one  in  which  testing 
is  terminated  after  a random  variable  reaches 


a preassigned  number,  e.g.,  number  of  fail- 
ures or  number  of  test  hours.  For  practical 
reasons,  all  life  tests  are  truncated  because 
of  economic  and  scheduling  factors.  Trun- 
cated life  tests  are  especially  suitable  when 
the  failure  rate  is  constant.  If  the  failure- 
time distribution  is  s-normal  or  lognormal, 
however,  the  mathematical  difficulties  of 
evaluating  the  results  of  truncated  tests  are 
quite  formidable.  This  is  also  true  for  other 
failure  distributions  with  nonconstant  failure 
rates  that  involve  more  than  one  unknown 
parameter. 

Seq-sample  tests  ought  not  to  be  used  in 
eontractual  situations  unless  the  OC  curve 


True  Percent  Defective  of  Submitted 
inspection  Lots 

Notes:  The  2 points  on  the  OC  curve,  which  are  nominaiiy 
the  same  for  aii  pians,  are: 

(1 ) Producer  risk  1 0%,  at  0. 7%  defective 

(2)  Consumer  risk  10%.  at  5%  defective. 

See  Ref.  1 for  detaiis  of  anaiysis. 

Figure  3-3.  Average  Amount  of  Inspection 
Under  Single,  Double,  Multiple, 
and  Sequential  Sampling  (ASN 
Curves)' 
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TA3LE  3-4 

COMPARISON  OF  SINGLE,  MULTIPLE,  AND  SEQUENTIAL  SAMPLE  PLANS 
(Adapted  and  modified  from  Ref.  1) 


Characteristic 

1 -sample 

m-sample 

sect-sample 

Sample  Size 

Known  (can  be  a random 
variable) 

Average  can  be  computed  for 
various  incoming  quality 
levels.  Often  less  than 
1 sample. 

Average  can  be  computed 
for  various  incoming 
quaiity  levels.  Often  less 
than  m-sample. 

Decision 

Choices 

Accept  or  reject 

Accept,  reject,  or  take 
another  sample  until  final 
sample  is  selected 

Accept,  reject,  or  test 
another  item 

Predetermines 

Characteristics 

Two  of  the  three 
quantities  A^,  cr,  or  (3 

Same  as  1 -sample 

Fix  a and  |3;  /V  is  a random 
variable 

Statisticai 

Considerations 

Must  know  distribu- 
tion of  sample 
statistic 

Same  as  l-sample 

Same  as  1 -sample,  a,P  are 
rarely  known  exactly. 
Usual  formulas  arc  very 
approximate. 

Personnel 

Training 

Requires  least 
training 

Better  trained  people  re  - 
quired than  for  single 

Requires  most  training 

Ease  of 

Administration 

Easiest.  Scheduling  can 
be  fairly  precise  and 
precise  test-cost  esti- 
mates can  be  made 

More  difficult  than  1 -sample 
since  the  exact  number  of 
rests  IS  unknown.  Only 
average  test,  costs  can  be 
estimated 

Most  difficult  in  terms  of 
testing,  scheduling,  and 
overall  administration. 
Most  time  consuming. 

Miscellaneous 

Best  used  for  testing 
situations  where  ease 
of  administration  is 
most  important  and 
cost  of  testing  is  rela- 
tively unimportant. 

Has  psychological  advantage 
in  that  supplier  is  given  a 
"second  chance”  by  taking 
further  samples  if  first 
sample  results  indicate  a 
marginal  lot. 

Can  be  most  "efficient"  un- 
der many  circumstances. 
Can  be  truncated  and  still 
maintain  good  a,  (5.  Con- 
sult statistician  knowledge- 
able in  this  area. 
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has  been  determined  for  the  particular  tests. 
The  nominal  OC  curv  e can  be  off  by  a factor 
of  2 or  so  in  a and  jS.  See  Refs.  21  and  22 
for  techniques  of  analyzing  the  seq-sample 
plans. 

3-5.3  SPECIAL  TESTS 

When  the  “reject”  decision  is  equivalent  to 
“test  the  entire  lot”  rather  than  “destroy  the 
lot”  or  something  equally  as  drastic,  the  test 
described  in  the  following  paragraph  may 
have  advantages  for  the  producer,  while  re- 
taining protection  for  the  consumer. 

Use  an  m-sample  or  seq-sample  test,  but 
move  the  “reject”  part  of  the  boundary  to 
“infinity”.  This  means  that  a lot  will  never 
by  rejected;  in  lieu  of  that,  one  may  have  to 
test  the  entire  lot  before  accepting  it.  But 
that  is  what  a “reject”  decision  would  have 
meant,  anyway.  Details  of  such  plans  are 
not  readily  available  in  the  open  literature. 
Ref  26,  sections  B.0933  and  B.0935  discuss 
such  plans,  at  least  in  principle. 

An  alternative  is  to  put  the  “reject”  line 
very  high;  so  the  probability  of  fully  testing 
an  acceptable  lot  is  very  small. 

3-5.4  ASSUMING  A FAILURE  LAW 

In  life  tests,  a failure  distribution  is  almost 
always  assumed,  and  it  usually  is  the  constant 
failure-rate  distribution.  The  parameter  to 
be  judged  is  the  failure  rate  (or,  equivalently, 
its  reciprocal). 

If  one  just  considers  the  fraction  good  or 
bad,  then  the  parameter  to  be  judged  is  the 
fraction  bad  (or,  equivalently,  the  fraction 
good).  This  assumption  (the  parameter 
“fraction  bad”  is  the  same  for  every  item 
tested)  is  much  more  likely  to  be  fulfilled 
than  is  the  assumption  of  a specific  failure 
distribution. 

Conventional  wisdom  states  that  parametric 


tests  are  “better”  than  nonparametric  tests 
since,  for  a given  amount  of  testing,  more 
precise  estimates  are  obtained  from  the 
parametric  tests.  However,  see  Ref  19  for 
a more  complete  discussion  of  this  point; 
many  nonparametric  tests  are  very  “good”, 
and  do  not  have  the  big  disadvantage  of 
having  made  the  wrong  distributional  assump- 
tion. 

Many  specifications  are  written  in  terms  of 
parametric  testing  or  in  terms  of  such  prop- 
erties as  mean-life  which  are  not  too  suitable 
for  nonparametric  tests.  For  example,  non- 
parametric tests  of  central  tendency  apply  to 
the  Cdf  while  the  specification  may  be  in 
terms  of  mean  life.  This  might  require  a 
change  in  specifications. 

An  incorrect  assumption  of  the  underlying 
failure  distribution  in  a parametric  test  can 
lead  to  an  OC  curve  that  differs  greatly  from 
that  planned,  especially  for  small  sample  sizes. 
This  is  not  a problem  in  nonparametric  tests. 
Also,  nonparametric  tests  are  generally  easy 
to  eonduct  and  evaluate,  and  often  require 
only  counting,  adding,  subtracting,  or  ranking; 
see  Ref  19. 

3-5.5  REPLACEMENT 

Replacement  here  is  not  used  in  its  statis- 
tical sense  of  discrete  nondestructive  sampl- 
ing (e.g.,  urn  problems  or  decks  of  cards). 

Replacement  tests  are  those  in  which  failed 
items  are  replaced  by  new  items,  so  that  the 
test  stations  are  always  full.  If  the  items  are 
complex,  replacement  may  be  interpreted  to 
be  restoration  of  the  failed  item  to  new  con- 
dition by  repair  or  replacement  of  failed 
components.  In  nonreplacement  tests,  failed 
items  are  not  replaced  or  repaired;  therefore, 
the  number  of  items  on  test  decreases  as  life 
testing  progresses. 

Generally,  the  effect  of  using  a replace- 
ment test  is  to  decrease  the  calendar  waiting 
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time  before  a decision  can  be  made  compared 
to  that  of  a nonreplacement  test  with  the 
same  number  of  items  on  test  originally. 

This  savings  in  calendar  time  is  accomplished 
at  the  cost  of  having  to  place  more  items  on 
test.  If  a sequential  test  is  used,  it  is  usually 
preferable  to  plan  for  a replacement  test, 
since  all  items  may  fail  in  a nonreplacement 
test  before  a decision  is  made,  and  more  test 
items  will  have  to  be  obtained. 

This  is  a practical  engineering  problem,  not 
a statistical  one.  The  required  data  are  the 
actual  operating  life  of  each  item,  regardless 
of  when  it  was  put  on  test. 

3-5.6  ACCELERATED  LIFE  TESTS 

An  accelerated  test  is  one  in  which  the 
test  conditions  are  adjusted  to  accelerate 
failure,  i.e.,  to  be  more  severe.  While  accel- 
erated tests  can  be  used  to  discover  and 
evaluate  critical  weaknesses  in  the  parts  or 
design,  their  attractiveness  in  acceptance  tests 
is  that  the  amount  of  test  time  is  reduced 
since  the  required  number  of  failures  for  a 
decision  will  occur  relatively  early.  This 
reduction  in  waiting  time  is  most  important 
for  items  that  have  very  high  reliability  goals, 
because  the  amount  of  test  time  required  to 
establish  conformance  can  be  very  large. 


severity-level  vs  parameter  of  a distribution 
(usually  the  constant  failure  rate),  the  un- 
certainty in  extrapolated  value  ought  to  be 
determined  at  the  nominal  conditions.  The 
actual  failure  rate  can  easily  be  uncertain  by 
a factor  of  10!  See  Ref  24  for  the  case 
where  the  time-independent  failure  rate  obeys 
the  Arrhenius  temperature  equation. 

It  is  easy  to  be  careless  about  just  what  is 
being  accelerated  in  an  accelerated  test. 

Most  often,  it  ought  to  be  a particular  param- 
eter in  a life  distribution.  If  the  distribution 
has  more  than  one  parameter,  then  the 
acceleration  behavior  of  all  parameters  ought 
to  be  justified.  For  this  reason,  accelerated 
tests  are  more  useful  in  the  design/develop- 
ment stage.  There,  it  is  not  the  actual  life 
that  is  important,  but  the  failure  mode/ 
mechanism  itself— and  whether  it  is  likely  to 
occur  at  usual  conditions. 

An  important  consideration  in  using  an 
accelerated  test  for  acceptance  testing  is  that 
the  supplier  might  design  his  product  to  pass 
your  accelerated  test,  rather  than  to  do  well 
in  the  field. 

Further  details  on  accelerated  tests  are 
given  in  Chapter  7 “Accelerated  Tests”. 


If  the  stress  conditions  are  accelerated,  the 
reliability  goal  under  standard  stress  condi- 
tions had  to  be  modified  accordingly.  There- 
fore, the  relationship  (approximate)  of  reli- 
ability to  the  acceleration  factor  must  be 
known,  so  that  appropriate  test  criteria  can 
be  established.  Most  accelerated  life  tests 
are  performed  at  the  part  level  because  of 
the  stringent  reliability  requirements  existing 
at  this  level  and  because  stress/failure  relation- 
ships are  relatively  easy  to  determine  through 
experimentation. 

It  pays  to  repeat  the  warnings  about 
extrapolation  from  experimental  data.  If  a 
regression  line  has  been  determined  for 


3-6  BINOMIAL  PARAMETER 

This  paragraph  describes  the  statistical 
characteristics  of  tests  to  which  binomial 
distribution  theory  applies.  For  reliability, 
the  test  characteristic  of  interest  is  often  the 
fraction-defective  (failed)  over  some  fixed 
time  of  operation. 

If  Ao  represents  the  ARL  and  Ry  the  URL, 
the  test  specification  is  of  the  following  form: 


i/o:  R = R^ 

(3 -6a) 

(3 -6b) 

3-18 


AMCP706188 


and 

Producer  Risk:  a 

Consumer  Risk:  jS 

For  “1-shot”  items,  where  time  is  not  in- 
volved, the  item  is  tested  for  performance 
without  considering  test  time  per  se. 

3-6.1  1 -SAMPLE 

If  the  lot  size  is  large  in  relation  to  sample 
size,  the  binomial  distribution  can  be  used 
to  generate  the  OC  cuive  of  a 1-sample  plan. 
Accept  or  reject  decisions  are  made  by  testing 
N items  for  time  T. 

The  lot  is  accepted  if  the  number  of  fail- 
ures is  less  than  or  equal  to  c,  the  acceptanee 
number.  If  R is  the  true  s-reliability  for  the 
test  mission,  the  probability  of  acceptanee 
Pa  (a  point  on  the  OC  curve)  is 

Pa^)  = z:  (3-7) 

ft=0  ' 

where 

N = the  number  of  items  tested 

c = the  maximum  allowable  number  of 
failures  (accept  with  c,  reject  with 
c + 1) 

R = the  true  s-reliability 
R = \ -R 

If  R is  small  enough,  say  /?  < 0. 1 and  N is 
large  enough,  say  N > 10,  the  Poisson  ap- 
proximation can  be  used  to  obtain  Pa  from 

F’a®  = i = Poific-,  NR)  (3-8) 

ft=0  «• 

where 

p = NR 

See  par.  2-3.1  for  a discussion  of  this  distribu- 
tion. 


In  order  to  meet  the  test  requirements, 
values  of  N and  c must  be  chosen  so  that 

Pa(Ro)  = 1 

Pam  = P ) (3-9) 

Because  c and  N are  integers,  it  usually  is  not 
possible  to  find  a 1-sample  plan  that  satisfies 
Eq.  3-9  exactly.  Presumably  this  has  been 
realized  before  contractual  obligations  were 
ineurred.  Since  the  Rq  ,Ri  , 'ey,  and  j3  are 
somewhat  arbitrary  anyway,  a reasonable  set 
of  parameters  is  chosen  which  is  close  to  the 
original  plan  . 

Table  3-5  can  be  used  to  determine  the 
1-sample  plan  (N  and  c)  for  various  values 
cf  the  discrimination  ratio  y (see  Eq.  3-5) . 

y = Ri/Ro 

and  various  sets  of  =y  and  ()•  For  a given  set 
of  a,|3,  and  y,  Table  3-5  lists  c and  a param- 
eter D.  The  sample  size  A is 

N = [D/Ro]  (3-10) 

where  (x]  is  the  largest  integer  Table 
3-5  is  an  extension  of  Table  2C-5  in  Ref  8. 

Example  Nos.  22  and  23  illustrate  the 
procedure. 

Table  3-6  presents  1-sample  plans  that 
approximate  the  OC  requirements  for  eom- 
mon  sets  of  Aq > Aj , of,  and  (3.  The  s-expected 
sample  sizes  for  “equivalent”  sequential  plans 
are  also  shown  (Ref  1). 

Tables  3-5  and  3-6  have  some  differences 
(usually  mmor)  in  N and  c for  the  same 
nominaf  f-sample  test  speeifieation.  Table 
3-5  is  based  on  the  Poisson  distribution,  and 
the  plans  are  derived  so  that  a.  is  guaranteed 
and  J3  is  no  more  than  speeified.  Table  3-6 
is  based  on  the  binomial  distribution,  and 
the  eriterion  used  was  to  meet  both  the  a 
and  |3  requirements  as  nearly  as  possible.  If 
[text  continues  on  page  3-24] 
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TABLE  3-5 

ATTRIBUTE  1-SAMPLE  PLANS  FOR  NOMINAL  a, ft  7 (Ref.  1) 


a = 

^01 

a = 

.05 

a = 

.10 

y 

.01 

.05 

.10 

.01 

^ .05 

£1 

.10 

.01 

t 

= .05 

(3  = 

.10 

£ 

D 

c 

D 

c. 

X. 

D 

D 

SL 

D 

c 

£ 

c 

D 

c 

D 

1.5 

135 

110.4 

100 

79.1 

82 

63.3 

94 

79.6 

66 

54.1 

54 

43.4 

76 

66.0 

51 

43.0 

40 

33.0 

2 

45 

31.7 

34 

22.7 

29 

18.7 

32 

24.2 

22 

15.7 

18 

12.4 

25 

19.7 

17 

12.8 

14 

10.3 

2.5 

26 

16.4 

20 

11.8 

17 

9.62 

18 

12.4 

13 

8.46 

10 

6.17 

14 

10.3 

10 

7.02 

8 

5.43 

3 

18 

10.3 

14 

7.48 

12 

6.10 

12 

7.69 

9 

5.43 

7 

3.98 

10 

7.02 

7 

4.66 

5 

3.15 

3.5 

14 

7.48 

11 

5.43 

9 

4.13 

9 

5.43 

7 

3.98 

6 

3.29 

7 

4.66 

5 

3.15 

4 

2.43 

4 

11 

5.43 

9 

4.13 

8 

3.51 

8 

4.70 

6 

3.29 

5 

2.61 

6 

3.90 

4 

2.43 

3 

1.75 

4.5 

10 

4.77 

8 

3.51 

7 

2.91 

6 

3.29 

5 

2.61 

4 

1.97 

5 

3.15 

3 

1.75 

2 

1.10 

5 

8 

3.51 

7 

2.91 

6 

2.33 

6 

3.29 

4 

1.97 

3 

1.37 

4 

2.43 

3 

1.75 

2 

1.10 

7.5 

5 

1.78 

4 

1.28 

4 

1.28 

3 

1.37 

3 

1.37 

2 

.818 

3 

1.75 

1 

.532 

1 

.532 

10 

4 

1.28 

3 

.823 

3 

.823 

3 

1.37 

2 

.818 

2 

.818 

2 

1.10 

1 

.532 

1 

.532 

/’g(ff) 

= 

probability  of  acceptance,  given  the  true  unreiiability  is  ff 

c - acceptance  number  (lot  is  accepted  for  c or  fewer  defectives;  it  is  rejected  otherwise) 


N = sampie  size 

^ ^ = nominai  producer  and  consumer  risks  (actuai  risks  depend  on  the  exact  vaiues  of  c and  /V) 

D D is  defined  such  that  N=  [D/ffjl  .where  lx]  = "largest  integer < x" 

/= 


^ (/?o)  « 1 - a;^g 
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Example  No.  22 

A small  electronic  subassembly  is  subjected  to  a reE'  ' -Mty  test.  The  subsystem 
is  tested  for  200  hr  and  the  number  of  failures  is  counted.  The  AAL  is  Rq  = 0.05  with 
a = 10%.  The  URL  is/?i  = 0.20  with  /3  = 5%.  Determine  the  sample  size  and  accep- 
tance number  for  a 1 -sample  attributes  test. 


Procedure 

1.  Calculate  the  discrimination  ratio 
from  Eq.  3-5. 

2.  Find  c and  D from  Table  3-5. 

3.  Calculate  the  sample  size,  from 
Eq.  3-10. 

The  test  plan  is  N = 48,  c = 4. 

4.  Use  Eqs.  3-7  and  3-9  to  calculate 
the  true  a and  /?. 


Example 

1.  y=  0.20/0.05 

= 4.00. 

2.  For  a =0.10,  ;S  = 0.05,  and  y=  4.00, 
from  Table  3-5, 

D = 2.43 

c =4 . 

= 48. 

4.  true  a = 9.07% 
true  )5  =2.48%. 
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Example  No.  23 

Design  a 1 -sample  plan  so  that  if  the  average  lot  reliability  for  a 100-hr  period 
is  0.99,  there  is  a 90% probability  cf  acceptance,  and  if  the  average  lot  reliability  is 
0.95,  there  is  only  a 10%probability  of  acceptance. 


Procedure 


1.  State  the  parameters  of  the  problem. 


2.  Compute  y from  Eq.  3-5. 

3.  Enter  Table  3-6  for  the  appropri- 
ate parameters  and  determine  Nand 
c for  a 1 -sample  plan. 


4.  Use  Eqs.  3-7  and  3-9  to  calculate 
the  true  a,  |3, 


Example 

1.  The  parameters  are 
a =0.10 

|3  = 0.10 

= 0.99,  Ro  = 0.01 
= 0.95,  = 0,  05. 

2.  7 = 0.05/0.01 

= 5.00. 

3.  For  a 1-sample  plan  with  a = 0.10. 
/3=0.10,  andy=5,  from  Table  3-6 
we  get 

N = 110 

c = 2. 

Therefore,  1 1 0 items  must  be  tested 
for  100  hr  each,  and  the  lot  is  ac- 
cepted if  2 or  fewer  failures  occur. 

4.  true  a = 9.87% 
true  = 8.3%. 
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TABLE  3-e 


ATTRIBUTE  SAMPLING  PLANS  FOR  SOME  NOMINAL  a,|3,  y (Ref.  1) 
(The  1 -sample  and  seq-sample  plans  will  not  have  the  same 
a,|3;  and  neither  plan  will  have  the  actual  a,|3.) 


seq-sample  plan  seq-sample  plan  seq-sample  plan  seq-sample  plan 

1-sample  Average  Sample  1-sample  Average  Sample  1-sample  Average  Sample  1-sample  Average  Sample 

plan  Number  plan  Number  plan  Number  plan  Number 


«0 

7 

N 

c 

R = 1 R 

- /?o  R = Ri 

N 

c 

R = 1 

R ~ Rq  .R  ~~  R\ 

N 

c 

R = 1 

/?  = /?,« 

= «o 

N 

c 

R = 1 

R = Ro\R 

' = /?! 

a = 0.10,  |3 

= 0.10 

a 

= 0.10,13  = 0.20 

a=  0.20,13  = 0.10 

a = 0.20,  ^ = 0.20 

0.99 

0.98 

2 

950 

13 

199 

437 

582 

650 

9 

136 

285 

451 

650 

9 

188 

339 

379 

400 

6 

125 

206.9 

275 

.97 

3 

320 

5 

104 

175 

142 

180 

3 

71 

114 

110 

220 

4 

98 

136 

93 

140 

3 

65 

83 

67 

.95 

5 

110 

2 

53 

69 

43 

60 

1 

36 

45 

33 

78 

2 

50 

54 

28 

60 

2 

33 

33 

20 

.90 

10 

37 

1 

23 

25 

12 

30 

1 

16 

16 

9.4 

22 

1 

22 

19 

7.9 

16 

1 

15 

12 

5.8 

.95 

,90 

2 

190 

13 

40 

103 

87 

113 

8 

28 

67 

67 

129 

9 

38 

80 

56 

78 

6 

25 

49 

41 

.85 

3 

60 

5 

20 

35 

25 

35 

3 

14 

23 

19 

46 

4 

19 

27 

16 

31 

3 

12 

16 

12 

.75 

5 

20 

2 

9.3 

12 

7.8 

11 

1 

6.4 

7.9 

6.1 

16 

2 

8.8 

9.4 

5.1 

11 

2 

5.9 

5.8 

3.7 

.50 

10 

8 

1 

3.4 

3.6 

2.2 

5 

1 

2.3 

2.3 

1.7 

4 

1 

3.2 

2.8 

1.4 

4 

1 

2.2 

1.7 

1.0 

.90 

.80 

2 

80 

11 

19 

48 

40 

56 

8 

13 

31.3 

30 

59 

8 

18 

37 

26 

39 

6 

12 

23 

19 

.70 

3 

25 

4 

8.8 

15 

11 

18 

3 

6.0 

9.9 

8.9 

23 

4 

8.3 

11 

7.5 

9 

2 

5.5 

7.2 

5.4 

.50 

5 

9 

3 

3.7 

4.8 

3.4 

5 

1 

2.6 

3.1 

2.7 

8 

2 

3.5 

3.7 

2.2 

5 

2 

2.4 

2.3 

1.6 

.85 

.70 

2 

49 

10 

11 

29 

25 

33 

7 

7.7 

18.6 

19 

35 

7 

11 

22.1 

16 

21 

5 

7.1 

14 

11 

.55 

3 

16 

4 

5.1 

8.6 

6.8 

11 

3 

3.5 

5.6 

5.4 

10 

3 

4.8 

6.6 

4.5 

6 

2 

3.2 

4.1 

3.3 

.80 

.60 

2 

33 

9 

7.6 

19 

17 

24 

7 

5.2 

12 

13 

24 

7 

7.2 

15 

11 

16 

5 

4.8 

9.1 

8.0 

.40 

3 

9 

3 

3.2 

5.3 

4.6 

6 

2 

2.2 

3.4 

3.6 

7 

3 

3.0 

4.1 

3.0 

4 

2 

2.0 

2.5 

2.2 

Pg{R)  = probability  of  acceptance,  given  the  true  unreliability  is/7 

c = acceptance  number  (lot  is  accepted  for  c or  fewer  defectives;  it  is  rejected  otherwise) 

= nominal  producer  and  consumer  risks,  respectively  (actual  risks  depend  on  the  exact  values  of  c and  N) 
N = sample  size 
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the  actual  a and  j3  were  shown,  the  source 
and  explanation  of  the  difficulties  would  be 
obvious. 

Tables  3-5  and  3-6  illustrate  the  following 
major  points : 

1.  Sample  size  varies  inversely  with  a,j3, 
and  7 (^0  fixed). 


r = number  of  failures  observed  so  far 
The  3 decisions  at  each  point  are: 

1.  Accept  the  lot  if  r{n)  <r^(n) 

2.  Reject  the  lot  if  r{n)  > rjf(n) 

3.  Continue  testing  otherwise. 


2.  Sample  size  varies  inversely  with  Rq 
(y  fixed). 

3-6.2  SEQUENTIAL  SAMPLING 

In  order  to  construct  a seq-sample  plan, 
the  accept  and  reject  decision  lines  (such  as 
those  shown  in  Fig.  3-2(C))  are  computed 
from : 

OA  h = in  (Ri/Ro) 

ajt  = in  ) b2^in  {Rq/Ri) 

' 

g = i—-  (slope) 

02  + 01 

h (intercept)  i (3-12) 
(intercept) 

Ordinarily,  the  a's,  b's,  h’s,  ai^  s are  all 
positive;  s is  always  between  Rq  and  R^. 

The  accept  line  equation  is 

r_A  = “ Aa  s"  (3-13a) 

The  reject  line  equation  is 

rR  = hji  + sn  (3- 13b) 

where 

n = the  actual  number  of  items  tested  so 
far 


Eqs.  3-12  and  3-13  were  adapted  from 
Chapter  VIII  of  Ref.  23;  Part  II  of  Ref.  23 
is  an  excellent  discussion  of  sampling  plans 
for  variables  and  attributes.  The  probabilities 
of  acceptance  P^iR)  have  5 special  qualities: 

PaW  = 1 

PaCRo)  = 1 - a 

Pfld  “•  s)  = o,R/{aA  + cir)  (3-14) 
Pa(R\)  = /3 
P<i(0)  = 0 

. 

These  are  nominal  characteristics;  the  actual 
a and  jS  are  smaller  than  shown. 

For  seq-sampling,  the  number  of  items  to 
be  tested  is  not  predetermined,  but  is  a 
random  variable  whose  average  is  a function 
of  the  true  reliability  . The  average  sample 
number  ASN^  (number  of  observations  be- 
fore a decision  is  reached)  for  incoming  reli- 
ability levels  of  A = 1 , Rq  > 1 — s,  A i , 0 is: 

ASNi  = 0^/62 

ASNjjg  = (Sc^  + aaj?)/(Ro&i  + P0&2) 

ASNi.s  = (flA/&2)(aji/&i) 

ASNjjj  = (/^Oa  + ^je)/(Ribi  + R1&2)  ^3  ^5) 

ASNq  = OR/h^ 

where 

a = 1 — a 

jSs  1 -/3 
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Remember  that  the  actual  a.  j3  will  be  appre- 
ciably different  from  those  used  in  Eqs.  3-1 1 
and  3-14.  Exact  analyses  are  “available”  for 
some  sequential  plans,  but  they  are  tedious 
to  program  for  a computer:  Ref  17  has  exact 
analyses  for  its  plans,  but  they  are  for  the 
exponential  distribution.  In  general,  the 
tests  computed  from  Eqs.  3-1 1 and  3-12  can 
be  appreciably  truncated  without  actually 
exceeding  the  nominal  a,j3. 

Example  No.  24  illustrates  the  procedure. 

3-6.3  EXPONENTIAL  ASSUMPTION 

The  attributes  test  is  similar  to  the  bino- 
mial case  in  terms  of  test  operation  arid 
criteria  (Ref.  1).  The  major  difference  is  that 
R is  replaced  by  the  exponential  formula 
exp 

where 

Tj^  = mission  time 

h = failure  rate 

The  “amount  of  testing”  can  be  measured  by 
any  of  the  following  parameters: 

N = number  of  items  on  test 

r = number  of  failures 

Wt  = waiting  time  before  a decision 
(time  elapsed  from  start  of  test 
to  the  time  a decision  is  reached) 

T = total  number  of  accumulated  test 
hours  before  a decision  is  reached 

If  ARL  and  URL  are  specified  in  terms 
of  failure  rate,  and  if  a mission  length  Tm 
can  be  determined  for  the  item,  this  type  of 
test  might  be  appropriate.  This,  in  turn,  will 
yield 

R^m  = exp  (-  Xo^Af)  (3-16a) 


7?l(T)  - exp  (-  XiT^)  (3-16b) 

the  ARL  and  URL,  respectively,  for  a reli- 
ability specification  for  hours. 

The  conversion  of  specified  failure  rates  to 
probability-of-survival  specifications  will  lead 
to  exactly  the  same  types  of  tests  discussed 
in  pars.  3-6.1  and  3-6.2.  However,  because 
of  the  exponential  assumption,  the  s-expected 
waiting  time  before  a decision  is  made  can  be 
calculated. 

For  the  1 -sample  case.  Table  3-5  can  be 
used  to  determine  N and  c.  It  is  shown  in 
Ref  11  that  the  s-expected  waiting  time  be- 
fore a decision  is  reached  (as  a function  of 
true  s-reliability  R ) is 

ERiWit,}  = E (3- 1 7) 

where 

The  term  is  extensively  tabulated 

in  Ref  1 1 for  many  sets  of  k and  N, 

3-7  EXPONENTIAL  PARAMETER,  LIFE 
TESTS 

The  distribution  of  failure-times  is  expo- 
nential: 

R(t)  - ejq)  (-  \t)  (3-18) 

where 

t = failure  time  (e.g.,  time  to  failure, 
or  time  between  failures) 

R(t)  = S'/It} 

A = a scale  parameter  (failure  rate); 

1/x  = e = £■  (t) 
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Example  No,  24 

Design  a sequential  sample  plan  so  that  if  the  average  lot  reliability  for  a 100-hr 
period  is  0.99,  there  is  a 90% probability  of  acceptance,  and  if  the  average  lot  re- 
liability is  0.95,  there  is  only  a 10%probability  of  acceptance. 


Prnrpdiirp 

1.  State  the  parameters  of  the 
problem 


2.  Compute  a^,  bi,  62  from 
Eq.  3-11. 


3.  Computes,  h^,  from  Eq. 
3-12. 


Example 


1.  The  parameters  are 
a?  = 0.10 
j9  = 0.10 

= 0.99,  Rq  = 0.01 
= 0.95,  Ri  = 0.05. 


« , /l-O.lOX 

= 2.1972 

=ln[(l  - 0.10)/0.10] 
= 2.1972 


61  =ln(0.05/0.01) 
= 1.60944 

62  = ln(0.  95/0. 90) 
= 0.05407 

&1  +&2  = 1.6635. 


^ 0.05407 

^ 1.6094  +0.05407 

= 0.03250 

hx  = 2.1972/1.6635 
= 1.3208 

Hr  = 2.1972/1.6635 
= 1.3208. 
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Example  No.  24  (Cont'd) 


4 Write  the  equations  for  the 
accept  and  reject  lines.  Use 
Eqs.  3- 13a  and  3-13b. 


5.  Compute  the  5 nominal  prob- 
abilities cf  acceptance  from 
Eq.  3-14. 


4.  The  accept  line  is 

r^  = - 1.3208  +0.03250n 

The  reject  line  is 

rji  = + l.  3208  + 0.  03250n. 

5.  p^a)  = 1 

P„(0.99)  = 1-  10%=  90% 

2 1 072 

P^(0.95)  = 10% 

Pa(0)  = 0%. 


6.  Compute  the  average  number 
of  items  tested  before  a de- 
cision, for  R values  in  Eq. 
3-15. 


6.  ASNi.o 


2.1972 

0.05407 


= 40.64 


ASN, 


^ (0.90  X 2.19721  + (0.10  x 2.19721 
(0.01  X 1.6094)  +(0.99  x 0.05407) 

= 31.56 


AexT  - 2.1972  2.1972  „ 

ASNo.9675  - Q^Q54Q7  1.6094 


ASN, 


ASN 


^ (0.10  X 2.1972)  + (0.90  x 2.1972) 
(0.05  X 1.6094)  +(0.95  x 0.05407) 

= 16.67 

= 1.37  -*  2. 


2.1972 


1.6094 


No  truncation  lines  are  calculated  for  this  example. 


3-27 


AMCP  706-198 


For  convenience  in  the  algebra,  the  tests  are 
discussed  in  terms  of  A;  the  translation  to  8 
is  easily  made.  Test  specifications  are  pre- 
sumed to  be  in  the  form  of  a Xq  ^oxARL, 
and  Xi  for  the  URL.  Specifications  given  in 
terms  of  i?  or  8 can  easily  be  converted  to 
A.  Only  2 types  of  tests  are  in  common  use: 
1-sample  and  seq-sample. 

The  concept  of  total-test-time  is  important. 
It  is  the  cumulative  operating  time  of  all  units 
regardless  of  any  censoring  or  of  staggered 
starting  times  or  of  replacements.  It  is  to  be 
distinguished  from  clock  (calendar)  time. 

Replacement  affects  clock-time,  but  not 
total-test-time.  The  number  of  test-stations 
might  be  limited,  or  the  number  of  available 
equipments  to  go  on  test  might  be  limited. 

The  test  statistic  is  always  total-test-time,  but 
the  relationship  among  number  of  equip- 
ments for  test,  number  of  test-stations,  and 
clock-time  for  the  test  depends  on  the  initial 
number  on  test,  whether  test-stations  are 
kept  occupied  (replacement),  and  other  phy- 
sical strategies.  None  of  these  affects  the 
final  decision,  they  affect  only  the  clock-time 
at  which  the  final  decision  can  be  made. 

3-7.1  l-SAMPLE 

Virtually  all  1-sample  plans  are  truncated 
(curtailed),  i.e.,  the  test  is  stopped  when  a 


deeision  boundary  is  reached;  see  Fig.  3-2, 
with  n replaced  by  total-test-time.  The 
average  “elock-time  to  decision”  is  shorter 
if  more  test  stations  are  used.  Table  3-7 
shows  how  the  average  “clock-time  to  deci- 
sion” depends  on  the  number  of  test  stations 
in  the  nonreplacement  case. 

The  savings  in  time  can  be  put  in  quantitative 
terms,  as  Table  3-7  shows.  To  derive  Table 
3-7,  define  E jJ  , the  average  waiting  time 
to  observe  the  first  r failures  from  s test- 
stations  (no  replacement),  r. 

XE{trJ=s  (3-19) 

j=i  * j ^ 

The  entries  in  Table  3-7  are  values  of  the 
ratio  E (^r,r}  which  quantitatively 

measures  the  time  saved,  and  is  independent 

of  A. 

In  many  cases,  the  (s  - r)  units  that  have 
not  failed  will  still  be  serviceable.  If  the 
failure  distributions  of  these  units  are  actually 
exponential,  the  survivors  will  be  as  good  as 
new.  Even  if  the  survivors  deteriorate  enough 
to  render  them  unfit  for  further  service,  the 
appreciable  savings  in  time  may  be  worth  the 
eost  of  the  additional  units. 

Example  Nos.  25  and  26  illustrate  the 
proeedure. 


TABLE  3-7 

RATIO  OF  s-EXPECTED  WAITING  TIMES  TO 
OBSERVE  FAILURE  r IF  THERE  ARE  s 
TEST-STATIONS 


s 


r 1 

2 

3 

4 

5 

10 

15 

20 

1 1 

0.50 

0.33 

0.25 

0.20 

0.10 

0.067 

0.050 

2 . . . 

1 

0.56 

0.39 

0.30 

0.14 

0.092 

0.068 

3 . . 

1 

0.59 

0.43 

0.18 

0.12 

0.067 

4 . . 

1 

0.62 

0.23 

0.14 

0.104 

5 ■ ■ 

1 

0.28 

0.18 

0.125 

10  . . 

1 

0.35 

0.23 
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Example  No.  25 

Compare  the  “average  clock-time  for  a test  that  requires  that  all  10  units  (10  test 
stations)  fail”  with  the  “average  clock-time  for  a test  in  which  10  units  of  20  fail  (20 
test  stations).” 


Procedure 


Example 


1.  State  the  values  of  r and  s.  1.  r = 10,  s = 20. 

2.  Determine  the  ratio  of  to  2.  From  Table  3-7,  ratio  = 0.23. 

from  Table  3-7. 

This  result  clearly  indicates  the  substantial  savings  in  clock-time  (on  the  average) 
which  can  result  from  using  more  than  the  minimum  number  of  test  stations  (in  the 
nonreplacement  case). 
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Example  No.  26 

= 1%,  /9  =2.5%,  y =2. 


Find  the  1 -sample plan  that  gives  a 
Procedure 

1.  Use  Table  V in  Ref.  18,  or  equiva- 
lent chi-square  tables.  Use  Eq. 
3-21. 


2.  By  trial  and  error,  find  the  v such 
that  Eq.  3-23  is  satisfied.  Use  only 
even  v since  r*  = v/2  is  an  integer. 
The  underline  indicates  a good 
answer. 


3.  Calculate  r*.  Rechoose  cy,  /3,  y to 
fit. 


4.  Use  Eqs.  3-21  and  3-22  to  find  T* , 


Example 

Use  the  2 columns 
csqfix^;v)  = 1% 

csqf{y}\  v)  — 100%  — 2 , 5%  = 97 . 5%, 
2 

9 X97.S%.  V ^ 2 

xk. 

V = 30:  47.0/15.0  = 3.13 

V = 40:  59.3/22.2  = 2.67 

V = 60;  83.3/37.5  = 2.22 

V = 74:  99.7/48.7  = 2.05 

V = 80:  106.6/53.5  = 1.993 
n = 78:  104.3/51,9  = 2.01.0. 

3.  r*  = 80/2  = 40 

choosey  = 1.993,  then  cy  = 1%, 
p = 2.5%  still. 

Xi%,80  “ =53,5 

X97,5  ,80  “ 2XiT*  = 106.6 

T*  = 26.75/\o  = 53.3/\i 
= 26.7500  = 53.301. 


1. 


Twenty  seven  to  53  (from  last  line  of  step  4)  is  an  outlandish  maximum  number 
of  failures  for  any  large  equipments;  so  the  cy,  IS,  y cannot  all  be  this  small.  The 
time  truncation,  about  270q,  is  also  outlandish  for  any  long-life  item. 
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The  decision  boundaries  for  the  1 -sample 
test  are  shown  in  Fig.  3-4(A).  When  the 
path  of  the  test  touches  or  crosses  a bound- 
ary (r  >,  r*,  or  T = T*)  the  appropriate 
decision  is  made.  The  OC  for  the  plan  does 
not  depend  on  the  number  of  test  stations 
nor  on  the  replacement  policy. 


r=l 

= poif{r*  — 1;m) 
= csqfc(2tJL;  2y*) 


(3-20) 


p = probability  of  an  “accept”  decision 
r*  = number  of  failures  for  rejection 


which  relates  r*,  a,j3,  7.  If  r*  and  2 of  the 
others  are  specified,  the  third  can  be  deter- 
mined exactly.  Since  r*  must  be  an  integer, 
it  is  not  possible  to  specify  a,  P,  7 and  deter- 
mine r*  exactly.  The  approximate  value  of 
r*  can  be  determined,  then  the  other  3 ad- 
justed to  give  “reasonable”  values.  See 
Example  No.  26. 

To  find  the  s-expected  clock-time  of  the 
test,  it  is  convenient  to  calculate  E {r}  . See 
Fig.  3-4(A).  If  the  test  path  hits  the  line^, 
the  probability  of  a particular  r is  just  the 
Poisson  formula  with  p = AT*,  and 
0 < r <r*.  If  the  test  path  hits  line  R,  it 
is  equivalent  to  hitting  the  upward  extension 
of  A for  r*  < r;  the  number  of  failures  is 
r*,  but  the  probability  is  the  Poisson  formula 
forr,  with  M = AT*.  Therefore  the  average 
r is 


H = AT*,  mean  number  of  failures  for 
failure  rate  A in  time  T* 

X = failure  rate 

T*  = total-test-time  for  acceptance 


r*-1 

E{r\\T*,r*]=  tS) 


+ r*  S 


g-y 


csqfc  (x^ ; v)  = complement  rf  the 

Cdf  with  V degrees  of 
freedom 


r*-2 

= E 


r»0 


r ! 


(3-24) 


Test  plans  are  available  in  Table  3-8,  Ref  9, 
Ref  17,  and  elsewhere.  Eq.  3-20  is  the  basis 
for  the  plans.  By  definition  of  a.  and  P,  Eqs. 
3-21a  and  3-21b  are  true. 


-r  r= 


r*-l 

E 

X=0 


£HeL\ 

r ! / 


= jU  csqfc(2ix;  2r*  — 2) 


a = csqf(2\QT*-,  2r*)  (3-2 1 a) 

1-13=  csqf(2XiT*;  2r*)  (3-2 lb) 

Define  Xp.v  such  that 

P = csq/iXp.u;^)  • (3-22) 

Then  Eq.  3-21  becomes 

^ (3-23) 

^ai2r* 


-I-  r*  csqf(2/J, ; 2r*)  ) 

This  formula  is  also  derived  in  Ref  11.  It  is 
straightforward  to  show  that 

AE  (T;  A,  T*  r*}  = E{r-,  A,  T*,  r*}  (3-2  5 j 

and  that  (for  replacement) 

sE  {clock-time;  A,  T*,r*} 

= E{T-,A,  T*,r*}  (3-26) 
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r = number  of  failures  so  far 
T = total  test  time  so  far 
r*,T*=  boundariesfor  r and  r 
A = "Accept"  portion  of  boundary 
R = "Reject" portion  of  boundary 


(B)  Seq-sample  plan  2-way  decision 

Figure  3-4.  Tests  for  the  Exponential  Parameter 
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where  s = number  of  test  stations 
H = AT" 

^ ^0 1 and  E {r,Xi)  , for  various  test 

plans,  are  given  in  Table  3-8. 


)3  = consumer  risk;  probability  of  accept- 
ing a lot  with  X = X[ , Xq  ^ 

T = total-test-time 


3-7.2  SEQ-SAMPLE 

Consult  pars.  3-5  and  3-6  for  a general 
discussion  of  seq-sample  tests  and  references 
for  further  reading.  Fig.  3-4(B)  shows  the 
decision  boundary  for  a typical  test.  The 
equations  for  the  lines  are  similar  to  those 
in  par.  3-6  for  the  binomial  parameter 
(adapted  from  Ref  13). 

<.A=8n(^)  I 


It  is  often  more  convenient  to  use  a normal- 
ized total-test-time  XqT  or  Xj  T,  rather  than 
T,  itself 

The  minimum  accept  time  is  for  = 0,  and 
is  (from  Eq.  3 -29a) 

= «a/6i,o  (3-30a) 

= = (3-30b) 


aR 


hi  “ Xj  — Xq  ; 

hl,0  = ^ ^ ; 

''■0 

hl,l  = ^ 


&2  =Cn  Xj  —Sn  Xq  =fin  (X^/Xq) 


(3-27) 


- ^a/ ^2 
hn  = an/bi 


(intercept)^ 
(intercept)  ( 


s - 61/62;  *0  ~ 61,0/62; 
«l  = 61,1/62 


(slope) 


|(3-28) 


+ sT  - — AjI  H-  So  ^ (XoT) 

= — h/^  + Sj  ^ (XjT) 

77?  “ 6);  sT  = -r  So  ^ (XoT) 

= H-  Si  X (XiT) 

where 


(3-29a) 
(3 -29b) 


a = producer  risk;  probability  of  rejecting 
a lot  with  X = Xq,  Xq  < Xj 


The  minimum  number  of  failures  to  reject  is 
for  T = 0,  and  is  (from  Eq.  3 -29b) 


'>^R,min^  hR  = ttR/bz  (3-31) 

The  computation  of  the  exact  a,|3  with 
truncation  is  done  with  special  computer 
programs.  The  basic  algorithm  is  simple 
enough,  but  the  calculations  are  horrendous 
for  large  tests.  Ref  17  shows  the  exact  a, 

/3  for  the  truncated  plans.  In  practice,  the 
truncation  of  a plan  as  calculated  from  Eqs. 
3-27,  3-28,  and  3-29  can  be  severe  without 
having  the  actual  a,/3  exceed  the  nominal 
ones. 

The  usual  difficulties  occur  with  this  test 
plan  as  with  any  such  plan.  If  Xi  and  Xq 
are  close  together,  and  a and  j3  are  small,  the 
test-time  for  X near  s can  be  quite  long.  Ref 
15  discusses  some  of  these  difficulties;  they 
are  far  from  being  resolved. 

It  is  usually  convenient  to  work  with 
a = /3.  It  makes  little  difference  how  they 
are  chosen  if  the  discrimination  ratio  is  avail- 
able for  adjusting.  After  all,  we  are  just 
picking  2 points  on  the  OC  curve  and  they 
might  as  well  be  convenient  ones.  Then 
and  5i  can  be  written  in  terms  of  the  dis- 
crimination ratio.  The  subscripts  A and  R 
on  a and  h can  be  dropped.  Eqs.  3-27, 
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TABLE  38 

TEST  PARAMETERS  AND  s-EXPECTED  NUMBER  OF  FAILURES  FOR  VARIOUS 
1-SAMPLE  AND  SEQSAMPLE  LIFE  TESTS  (ADAPTED  FROM  Ref.  1) 


1 -sam  pie  plans  seq-sample  plans 


a 

P 

Rejection 
Number,  r* 

x"/2 

1-a,  2r 

E 

{r/X) 

Truncation 
Number,  r* 

E 

{r/X} 

II 

<< 

II 

II 

X=X, 

0.05 

0.05 

67 

54.13 

54.0 

66.8 

201 

28.0 

36.7 

0.05 

0.10 

55 

43.40 

40.5 

54,6 

165 

21.1 

32.9 

0.05 

0.25 

35 

25.87 

24.0 

34.0 

105 

12.0 

23.5 

0.10 

0.05 

52 

43.00 

37.6 

51.8 

156 

25.1 

27.6 

0.10 

0.10 

41 

33.04 

32.8 

40.7 

123 

18.6 

24.4 

0.10 

0.25 

25 

18.84 

18.7 

24.2 

75 

10.1 

16.5 

0.25 

0.05 

32 

28.02 

27.3 

31.9 

96 

18.0 

15.7 

0.25 

0.10 

23 

19.61 

9.0 

22.7 

69 

12.6 

13.2 

0.25 

0.25 

12 

9.52 

9.1 

11.4 

36 

5.8 

7.6 

0.05 

0.05 

23 

15.72 

5.6 

22.9 

69 

8.6 

13.7 

0.05 

0.10 

19 

12.44 

2.4 

18.8 

57 

6.5 

12.3 

0.05 

0.25 

13 

7.69 

7.6 

12.4 

39 

3.7 

8.8 

0.10 

0.05 

18 

12.82 

2.7 

17.9 

54 

7.7 

10.3 

0.10 

0.10 

15 

10.30 

10.2 

14.8 

45 

5.7 

9.1 

0.10 

0.25 

9 

5.43 

5.3 

8.5 

27 

3.1 

6.2 

0.25 

0.05 

11 

8.62 

8.2 

10.9 

33 

5.5 

5.9 

0.25 

0.10 

8 

5.96 

5.6 

7.8 

24 

3.9 

4.9 

0.25 

0.25 

5 

3.37 

3.2 

4.7 

15 

1.8 

2.8 

0.05 

0.05 

10 

5.43 

5.4 

9.9 

30 

2.9 

6.1 

0.05 

0.10 

8 

3.98 

3.9 

7.8 

24 

2.2 

5.5 

0.05 

0.25 

6 

2.61 

2.6 

5.6 

18 

1.3 

3.9 

0.10 

0.05 

8 

4.66 

4.6 

7.9 

24 

2.6 

4.6 

0.10 

0.10 

6 

3.1  5 

3.1 

5.9 

18 

2.0 

4.1 

0.10 

0.25 

4 

1.74 

1.7 

3.6 

12 

1.1 

2.8 

0.25 

0.05 

5 

3.37 

3.2 

5.0 

15 

1.9 

2.6 

0.25 

0.10 

4 

2.54 

2.4 

3.9 

12 

1.3 

2.2 

0.25 

0.25 

2 

0.96 

0.86 

1.7 

6 

0.61 

1.3 

0.05 

0.05 

5 

1.97 

1.9 

5.0 

15 

1.1 

3.3 

0.05 

0.10 

4 

1.37 

1.4 

3.9 

12 

0.83 

2.9 

0.05 

0.25 

3 

0.82 

0.81 

2.7 

9 

0.47 

2.1 

0.10 

0.05 

4 

1.74 

1.7 

4.0 

12 

0.99 

2.5 

0.10 

0.10 

3 

1.10 

1.1 

2.9 

9 

0.73 

2.2 

0.10 

0.25 

3 

1.10 

1.1 

2.9 

9 

0.40 

1.5 

0.25 

0.05 

2 

0.96 

0.86 

1,9 

6 

0.71 

1.4 

0.25 

0.10 

2 

0.96 

0.86 

1.9 

6 

0.50 

1.2 

0.25 

0.25 

1 

0.29 

0.26 

0.8 

3 

0.23 

0.68 
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3-28,  and  3-29  become 


3-8  s-NORMAL  PARAMETER,  MEAN 


a = /S 


y = 

Xi/Xfl 

„ /l-a\  „ / 

'1 

a = 

fin  ( - j -8n  1 

\ /S  / ' 

V a 

*1,0 

= 7-1,  *1,1=1 

- 1/7 

*2  = 

= Cn  7 

(3-32) 


The  standard  deviation  is  presumed  to  be 
known  exactly,  and  the  mean  is  the  param- 
eter upon  which  acceptance  rests.  The  1- 
sample  plans  are  well  known  in  the  quality 
control  field.  Seqsample  plans  are  feasible, 
and  some  forms  of  the  plans  are  given  in 
this  paragraph.  No  truncation  data  are 
readily  available.  The  equations  are  adapted 
from  Ref  23,  Chap.  XV. 


A = a/&2 

50  = (7  - l)/(en  y)  , 

51  = (l  - ^)/ y)  = So/7 


i (3-33) 


r_A  = — A + So  X (XT) 
= — A -I-  Si  X (XiT) 
ru  = A + So  X (X  T) 

= A + Si  X (XiT) 


I (3-34) 


Notation  follows: 

M = actual  mean 

IJLff  = higher  mean 

IX I - low'er  mean 

Am  = (.IXff  - IXl  )/2 

0 = known  standard  deviation 


It  is  now  worthwhile  tabulating  b-^,  Sq,  Si  as 
functions  of  X;  see  Table  3-9. 


ccl  = probability  of  incorrect  decision 
when  M is  IXfj  or  iXi 


Example  Nos.  27  and  28  illustrate  the  pro- 
cedure. 


X = random  sample  from  s-normal 
population  with  mean  m and 
standard  deviation  o 


TABLE  3-9 

FACTORS  FOR  SEQ-SAMPLE  TESTS 

Zl,  Zh=  {x  - iXj^)/o  or  (x  - M/i)/o 

See  Eqs.  3-32,  3-33,  and  3-34 

in  the  text. 

7 = (Am)/c7,  discrimination  ratio 

7 

b-j. 

^0 

2,-  = sum  over  all  measurements  so 

1.25 

0.223 

1.120 

0.896 

far 

1.50 

0.405 

1.233 

0.822 

n = number  of  individual  items 

2.0 

0.693 

1.443 

0.721 

tested  so  far 

2.5 

0.916 

1.637 

0.655 

3.0 

1.099 

1.820 

0.607 

3.5 

1.253 

1.996 

0.570 

The  equations  for  the  choose  “m  is  Low” 

4.0 

1.386 

2.164 

0.541 

or  “m  is  High”  are  (when  m^  is  used  as  a 

5.0 

1.609 

2.485 

0.497 

reference) 
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Examole  No.  27 


A large  digital  computer  is  designed  as  the  heart  of  a battlefield  intelligence  and 
fire  direction  system.  Since  only  three  systems  are  available  for  test,  and  test  time 
is  limited  to  2000  hr  each,  it  is  decided  to  use  a sequential  test.  Investigate  a se- 
quential test  which  demonstrates  a minimum  acceptable  mean  life  of  1000  hr  for  a 
consumer  and  producer  risk  cf  0.1. 


Procedure 


Example 


1.  State  the  given  test  parameters  and 
choose  a set  of  suitable  equations. 


L a = /3  = 10% 

= 1/1000-hr 

Use  Eqs.  332  , 333  , 3-^4  with  X^T. 


2.  Calculate  a from  Eq.  332  . 

2. 

a = In 

L - 0.1\ 
0. 1 / 

= 2.197. 

3.  Construct  a table  which  shows  sj,  h, 

3. 

Y 

si 

h 

and  Ag  as  a function  of  y.  Use  Table 
3-9  and  Eqs.  3-32,  3-33,  3-34,  and 

1.5 

0.822 

5.419 

6.59 

3-30. 

2.0 

0.721 

3.170 

4.40 

3.0 

0.607 

2.000 

3.30 

5.0 

0.497 

1.365 

2.75 

Now  look  at  the  table  just  constructed.  If  the  supplier  is  willing  to  take  a 10% 
chance  of  not  passing  the  test  (a  large  chance  to  take  on  a big  contract),  he  must,  for 
example,  make  the  item  3 times  as  good  as  is  required  (y  = 3)  and  test  it  for  “3.30/Xi 
= 3300  hr  « 20  weeks”  cf  total  test  time  at  a minimum  (presumes  no  failures).  For 
every  failure,  he  must  test  for  another  “l/(siXi)  = 1650  hr  « 10  weeks”  if  he  is  to  pass 
the  test.  If  he  chooses  to  strive  only  for  twice  as  good  as  necessary  (y  =2),  then  he 
must  test  for  a minimum  of  “4.40/Xi  = 4400  hr  « 26  weeks”  of  total  test  time;  for 
every  failure  he  must  test  for  another  "1387  hr  « 8 weeks.”  Most  suppliers  don’t 
want  to  take  a 10%  chance  cf  failing  such  an  important  test,  especially  if  their  equip- 
ment is  2 to  3 times  as  good  as  required.  The  additional  requirement  that  total  test 
time  be  no  more  than  "3  x 2000  hr  = 6000  hr"  hampers  things  even  more;  6000  hr 
corresponds  to  a X^T  of  6,  which  means  that  they  = 1.5  option  is  not  even  open  to  him. 
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Example  No.  28 

Same  data  as  Example  No.  27  but  use  Ref.  17  to  solve  the  problem. 


Procedure 

1.  Pick  several  plans  that  have 

a = p = 10%. 

2.  Convert  the  time  axis  from  \qT 
to  XiT,  because  this  example  is 
given  in  terms  of  Xj. 

3.  Find  (truncation). 


4.  Choose  apian. 


5.  Check  the  OC  curve  and  s-ex- 
pected  test  time  curve. 


Example 

1.  In  version  B,  Rev.  July  1969,  there  are  2 

plans  which  might  be  applicable:  V and  VI. 

2.  Multiply  times  in  Plan  V by  y = 3,  and  in 
Plan  VI  by  y = 5. 


3.  Plan  V,  = 10.35 

Plan  VI,  Xir^  = 6.25. 

4.  Because  of  the  = 6000  hr”  (X^T  = 6) 

constraint.  Plan  VI  is  preferred  over 
Plan  V.  It  has  y =5,  and  actual  a,  /3  of 
about  13%,  (seep.  60,  Ref.  17). 

5.  (Seep.  68.  Ref.  17).  To  get  a rejection 
probability  of  4%  requires  XAi  » 10,  and 
of  2%requires  xAi  « 15.  The  s-expected 
test  time  for  very  good  equipment  is  about 
“3Ai  =3000  hr.” 


So  the  test  plan  that  fits  the  problem  constraints  requires,  in  essence,  that  the  equip- 
ment be  10  times  as  good  as  required,  just  to  keep  from  having  an  unreasonable 
chance  of  failing  the  test  when  the  equipment  is  much  better  than  needed. 

This  example  illustrates  the  paradox  brought  on  by  the  exponential  distribution 
and  expensive  tests. 
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Choose  “m  is  High”: 

S{Zl,{  = ("h/j)  + yn 
Choose  is  Low”: 

+ yn 

where 

“« " *" 

Where  is  used  as  a reference,  Eqs.  3-35 
become 

Choose  is  High”: 

- yn 

Choose  “q  is  Low”; 

= - (g£,/t)  - yn 

For  use  in  an  actual  situation,  the  Z’s  would 
be  converted  to  x’s  for  ease  in  use.  Eqs. 

3-35  and  3-37  are  helpful  in  visualizing  what 
happens  when  the  discrimination  ratio  is 
changed. 

3-9  BAYESIAN  STATISTICS 

A good  approach  to  Bayesian  statistics  is 
given  in  Ref  25;  an  idea  of  its  breadth  of 
application  is  found  in  Ref  26;  and  an  easy- 
to-read  discussion  of  its  controversial  nature 
is  propounded  in  Ref  27.  The  mathematics 
of  Bayesian  statistics  is  not  controversial  at 
all.  It  is  the  interpretation  of  those  equations 
concerning  knowledge  as  “prior”,  and  what 
constitutes  reasonable  “prior”  knowledge 
which  is  the  source  and  mainstay  of  the 
controversy. 

Engineers,  as  well  as  most  other  people, 
tend  to  confuse  what  they  hope  and  want 
to  be  true,  with  what  they  really  expect  is 


true.  If  one  is  to  use  Bayesian  statistics,  he 
must  evaluate  the  consequences  of  his  as- 
sumptions very  thoroughly,  before  running 
any  tests.  (Portions  of  this  paragraph  are  re- 
printed from  Ref  28,  with  permission.) 


3-9.1  PROBABILITY  AND  BAYES 
PROBABILITY 

Probability  is  a mathematical  concept  used 
in  connection  with  random  events,  i.e.,  those 
events  whose  occurrence  is  uncertain  enough 
that  the  uncertainty  is  of  concern  to  us.  One 
of  the  most  popular  uses  of  probability  is  in 
games  of  chance;  we  speak  of  the  odds  or 
percentages.  For  example,  in  a pair  of  honest 
dice  the  probability  of  throwing  “snake  eyes” 
is  2-7/9%;  the  probability  of  rolling  7’s  is 
16-2/3%.  In  these  uses  of  probability,  it  can 
be  shown  that  the  probability  is  associated 
with  the  “long  run”  percentages. 

Another  popular  use  of  probability  is  as 
degree-of-belief  We  speak  of  the  probability 
of  w inning  a case  at  law'  or  of  getting  a pro- 
motion. If  a person  is  prudent,  his  degree-of- 
belief  is  the  same  as  the  “long  run”  percent- 
age, when  that  percentage  is  known.  But 
“long  run”  percentages  usually  are  associated 
with  conceptual  models  such  as  unbiased 
coins  and  honest  dice.  It  is  degree-of-belief 
as  to  whether  the  coin  is  in  fact  reasonably 
unbiased,  or  the  dice  are  actually  honest. 

The  term  Bayes  probability  has  become 
associated  with  degree-of-belief  and  it  will  be 
used  in  that  sense  in  this  paragraph.  (Not 
everyone  uses  it  that  way-the  language  is  in 
a state  of  flux.)  The  Bayes  formula  provides 
a means  of  converting  the  degree-of-belief  we 
had  “before  a test  was  run”  to  the  degree-of- 
belief  we  have  afterwards;  degree-of-belief  is 
not  a static  thing,  we  change  it  whenever  we 
get  more  evidence.  Bayes  formula  provides 
the  mathematics  by  which  a rational  person 
has  his  degree-of-belief  changed  by  evidence. 
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3-9.2  SIMPLE  ILLUSTRATION 

To  use  the  Bayes  procedure,  we  must  first 
state  what  our  beliefs  are  about  every  pos- 
sibility in  our  conceptual  model.  Suppose 
we  wish  to  take  a stand  on  whether  a coin 
is  honest  or  not,  and  all  we  can  see  of  it  are 
the  results  of  legitimate  flips.  Row  1 in 
Table  3-10  shows  the  3 conditions  we  pre- 
sume are  possible  in  our  conceptual  model; 
the  coin  is  either  2-tailed,  fair,  or  2-headed. 
Row  2 shows  our  degree-of-belief  before  any 
tests  are  run;  we  are  99%sure  the  coin  is 
fair,  and  we  suspect  1/2%  each  that  the  coin 
is  2-tailed  or  2-headed.  Let  each  test  involve 
seeing  the  results  of  3 legitimate  flips  of  the 
coin.  Run  Test  A and  suppose  the  results 
are  3-heads,  0-tails.  Now,  separately  for  each 
condition,  calculate  the  likelihood  of  getting 
the  test  result  if  that  condition  is  true.  Ob- 
viously, under  condition  #1  (2-tailed  coin) 
for  example,  the  results  of  Test  A would  be 
impossible;  so  we  put  a zero  there.  By  means 
of  Bayes  formula,  our  “after  test  A”  degree- 
of-belief  is  calculated.  Reasonably  enough, 
we  now  suspect  more  strongly  that  the  coin 
is  not  a fair  one,  but  we  no  longer  suspect 
that  it  is  2-tailed.  After  the  results  of  Test 
B are  in,  we  are  even  more  suspicious  about 
the  coin’s  being  2-headed.  But  Test  C clears 
things  up;  since  we  have  observ'ed  at  least  1 
tail  and  1 head,  the  coin  can  be  neither  2- 
headed  nor  2-tailed.  Therefore  it  must  be 
fair,  according  to  the  conceptual  model  we 
set  up.  The  “after  test”  degree-of-belief 
often  serves  as  the  “before  test”  degree-of- 
belief  for  a subsequent  test,  as  in  this  Olustra- 
tion. 

3-9.3  BAYES  FORMULAS,  DISCRETE 
RANDOM  VARIABLES 

Bayes  formula  is 

Pr{Ei  I H}  cc  Pr{Ei}Pr{H  I £,}  (3-38) 

l/f}  = 1 (3-39) 


TABLE  3-10 


HONEST  COIN? 


(1) 

Condition 

probability  of  heads 

No.  1 
0 

No.  2 No.  3 
1/2  1 

(2) 

degree-of-belief  

. U2SL 

99%. 

U22L 

(3) 

likelihood  of  test  A results 
3-heads,  0-tails 

0 

1/8 

1 

(4) 

degree-of-belief  

. sm 

96% 

4% 

(5) 

likelihood  of  test  B results 
3-heads,  0-tails 

0 

1/8 

1 

(6) 

degree-of-belief  

0% 

70% 

24% 

(7) 

likelihood  of  test  C results 
1-heads,  2-tails 

0 

3/8 

1 

(8) 

degree-of-belief  

. 0% 

100% 

0% 

where 


Ef  - subevent  i for  E.  The  event 

space  is  partitioned  (exhaustive 
and  mutually  exclusive  sub- 
events) into  subevents. 

H - event:  new  test  results 

Pr  {Ej\  = prior  probabilities  assigned  to 
the  £,• 

Pr  {H\E^]  = likelihood  of  getting  the  new 
results,  given  that  £;•  were  in 
fact  true. 

a:  \Ei  \H]  = new  probabilities  assigned  to 
the  El,  after  seeing  the  test 
results. 

2,-  = implies  sum  over  all  i 


In  the  illustration  in  par.  3-9.2  (see  Table 
3-10),  rows  4,  6,  8 were  obtained  from  Eqs. 
3-38  and  3-39  as  shown  in  Example  No.  29. 

3-9.4  PRINCIPLES  FOR  APPLICATION 

Apply  the  following  principles: 
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Example  No.  29 


Procedure 

1.  State  prior  probabilities. 


2.  Experimental  result  (test  A)  was 
3 -heads,  0-tails.  Calculate 
Pr^\E^}\  row  3 in  Table  3-10. 


3.  Calculate  Pr{E,- 1 Fj.  Use  Eq.  3-38 
first. 


Use  Eq.  3-39  next.  Divide  by  the 
normalizing  factor  (thetotal). 


4.  New  experimental  result  H (testB) 
was  again  3-heads,  0-tails.  Cal- 
culate Pr{?/ 1 E,-};  row  5 in  Table 

3-10. 

5.  Calculate  Use  Eq.  3-38 

first.  The  probabilities  after  test 
A are  now  the  prior  probabilities 
for  test  B. 


Use  Eq.  3-39  next.  Divide  by  the 
normalizing  factor  (thetotal). 


Example 

1.  0.005,  Primal  = 0.99, 
Prfe}  = 0.005. 

2.  Ei  = 2-tailed  coin, 

Pr{ff  lPi>  = 0;E2  = honest  coin, 

Pr{tflP2}=5X  ix  i 

P3  = 2-headed  coin, 

Pr^  1^3}=  1. 

3.  Pr{Ei  iPj  oc  0.0050  X 0 = 0 

Pr^2  \H}  oc  0.990  X (I/8)  = 0.1238 
Pr{B3  IP;  0.0050  X = 0.0050 

Total  0.1288 

Pr{BilP;  = 0/0.  1288  = 0 
Pr{E2 \H}  = 0, 1238/0. 1288  = 0.9612 
Pr{&3 1 P}  = 0.  0050/0. 1288  = 0.0388 

4.  Pr{H\Ei}  = 0 

Pr{H  ( E2}  = = i 

Pr^lP3}  = l. 

5.  Pr^ilH}  oz  Ox  0 = 0 

Pr^z^H}  oc  0.9612  x (1/8)  = 0.1202 
Pr{Es  IP;  cc  0.0388  X 1=  0.0388 

Total  0.1590 

Pr^Si  ip;  = 0 

PriEz  \H}  = 0. 1202/0.  1590  = 0.7562 
Pr{E3lP}=  0.0388/0.1590  = 0.2441 
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Example  No, 

6.  New  experimental  result//  (testC) 
was  1-head,  2-tails.  Calculate 
Pr{H\E(}:  row  7 in  Table  3-10. 

7.  Calculate  I H}.  Use  Eq.  3-38 

first.  The  probabilities  after  test 
B are  now  the  prior  probabilities 
for  test  C. 


Use  Eq.  3-39  next  as  in  step  5. 


29  (Cont'd) 

6.  Pr^\Ei}  = 0 

Pr^l£2}  = 3x  (^)  X (^)2  =1 
PriH  1 £3}  = 0. 

7.  Pr^i  Hjcc  Ox  0 =0 

Pr^2  0.7562  x (3/8)  = 0.2836 

Py^3  //;  oc  0.2441  X 0 = 0 

Total  0.2836 

PriEilH}  = 0/02836  = 0 
Pr^2  0.2836/0.2836  = 1 
Pr^S^H}  = 0/0.2836  = 0. 


This  simple  illustration  shows  how  Bayes  formula  can  be  applied  repeatedly  to  a prob- 
lem as  more  test  data  become  available. 

Once  the  probability  of  any  E,  is  zero,  it  can  never  again  be  anything  but  zero. 
Thus,  it  is  important  to  allow  at  least  some  initial  prior  probability  for  any  possible 
outcome. 
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(1)  Each  possible  condition  of  the  un- 
known (in  the  conceptual  model)  must  be 
specified.  Seriously  consider  using  discrete 
values  to  represent  conditions,  because  we 
are  used  to  thinking  that  way.  Continuous 
values,  e.g.,  between  0 and  1,  can  be  used, 
but  then  step  2 is  often  very  deceptive  be- 
cause we  are  not  used  to  thinking  in  terms 
of  the  probability  density  functions  that  are 
then  needed;  it’s  like  trying  to  guess  which 
shell  the  pea  is  under. 

(2)  Assign  a prior  degree-of-belief  to  each 
of  the  conditions.  Leaving  out  a condition 

is  equivalent  to  assigning  zero  degree-of-belief 
to  it.  Once  zero  degree-of-belief  has  been 
assigned  to  a condition,  or  calculated  for  it 
after  a test,  the  degree-of-belief  for  that  con- 
dition remains  zero  forever  after.  So  we  must 
include  (at  least  approximately)  all  physically 
possible  conditions.  As  we  shall  see  in  the 
example  in  par.  3-9.5,  we  must  not  assign 
too  low  a degree-of-belief  to  the  unlikely 
regions.  A good  way  of  handling  the  assign- 
ment is  to  pretend  that  we  are  willing  to  bet 
money  on  the  outcomes  at  the  odds  we  have 
implicitly  specified  and  that  the  other  person 
can  choose  whichever  side  of  the  bet  he 
wishes. 

Exercise  your  model  with  hypothetical  test 
results;  see  if  your  afterwards  degrees-of-belief 
correspond  to  the  calculated  ones.  If  not, 
go  back  and  change  your  prior  degrees-of- 
belief 

(3)  Run  a test  which  is  intended  to  shed 
some  light  on  the  unknown.  Preferably,  the 
likelihood  of  the  test  results  should  be  quite 
different  for  each  condition. 

(4)  Eor  each  condition,  calculate  the  like- 
lihood of  the  test  results.  If  the  test  was 
chosen  well,  the  likelihood  will  be  quite 
different  for  each  condition. 

(5)  Use  Bayes  formula  to  calculate  the 
“after  test”  degree-of-belief 


(6)  If  the  degree-of-belief  is  not  sharp 
enough  (high  for  only  a few  close-together 
eonditions,  and  low  for  the  rest)  consider 
running  more  tests. 

When  a single  point  estimate  is  desired 
(instead  of  the  distribution),  we  can  choose 
the  most  probable  value,  the  average  value, 
the  median  value,  or  some  other  that  we 
prefer.  If  these  reasonable  choices  are  close 
together,  it  makes  little  difference  which  we 
ehoose.  If  they  are  far  apart,  we’re  in  trouble 
anyway— we  need  more  tests. 

Step  2 is  deceptively  simple  looking.  In 
praetiee  it  is  easy  enough  to  assign  a seem- 
ingly reasonable  degree-of-belief  to  each 
condition.  But  we  may  well  not  like  the 
“after  test”  degree-of-belief  we’re  supposed 
to  have.  A story  illustrates  the  point.  A 
man  kept  asserting  to  his  friends  that  he 
was  dead.  The  friends  finally  persuaded  him 
to  see  a medical  doctor.  The  doctor  hit  upon 
the  idea  of  a test;  said  he,  “Dead  men  don’t 
bleed  do  they?”  The  man  readily  agreed 
with  the  assumption  that  dead  men  do  not 
bleed  and  that  the  test  would  be  reasonable. 
Thereupon  the  doctor  stuck  the  man’s 
thumb  which  bled  profusely.  The  man 
looked  at  the  test  results  and  exclaimed, 

“By  golly,  dead  men  do  bleed!” 

Step  2 is  the  plaee  where  most  Bayesian 
disasters  oeeur.  The  utter  simplieity  of  the 
formulas  belies  the  skill  and  hard  work 
needed  to  apply  prior  probabilities  properly. 
What  you  think  you  believe,  and  what  you 
aetually  believe,  after  serious  analysis,  are 
often  very,  very  different.  The  literature 
abounds  with  examples  of  engineers  who 
tried  Bayesian  analysis  without  the  skill  and 
hard  work. 

3-9.5  COMPLEX  ILLUSTRATION 

Any  assignment  of  prior  degree-of-belief 
should  be  thoroughly  ehecked  by  simulating 
test  results  before  submitting  to  any  real 
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tests.  During  the  simulation,  we  may  wish 
to  change  our  assignment  of  prior  degree-of- 
belief 

Suppose  a portable  power  tool  is  to  be 
tested  for  insulation  breakdown  under  super- 
severe  conditions  (high  temperature,  high 
load,  high  humidity,  high  vibration).  If  the 
insulation  breaks  down  in  field  use,  injuiy 
or  death  could  result.  We  generate  row  1 of 
Table  3-1 1 by  considering  what  we  want  to 
know.  If  the  failure  probability  is  high,  we 
don’t  really  care  exactly  what  it  is  because 
it’s  “back  to  the  drawing  board”  anyway. 

The  lower  the  failure  probability,  the  closer 
we  want  to  know  it.  In  order  to  keep  the 
example  simple,  we  are  supposing  that  only 
6 possible  failure  probabilities  exist,  as  shown 
in  row  1.  Row  2 shows  the  degree-of-belief 
of  the  designer  before  submitting  to  this 
accelerated  test. 

Now  let’s  simulate.  Suppose  the  test  re- 
sults are  0-pass,  2-fail.  Row  4 shows  the 
“after  test”  degree-of-belief  for  each  condi- 
tion. No  one  in  his  right  mind  still  believes 


there’s  an  almost  50-50  chance  that  the  fail- 
ure probability  is  0.03.  The  analysis  was 
correct;  so  the  assumptions  were  bad.  The 
designer  was  too  optimistic— a very  common 
circumstance.  Row  5 is  a revised  “before 
test”  degree-of-belief  It  still  has  a large  peak 
at  condition  5,  but  the  bad  conditions  have 
higher  degrees-of-belief.  Now  with  an  hy- 
pothesized 0-pass,  2-fail  test  result,  the  “after 
test”  degree-of-belief  in  row  7 seems  more 
reasonable.  Let’s  try  the  same  “before  test” 
degree-of-belief  with  2-pass,  0-fail  results;  as 
shown  in  rows  8-10.  Row  10  gives  the 
“after  test”  degree-of-belief,  and  it  too  seems 
reasonable.  In  practice,  you  should  try  many 
more  simulations  of  test  results  before  coming 
to  a conclusion  about  your  “before  test” 
degree-of-belief. 

You  may  wish  to  have  your  problem  pro- 
grammed for  a computer;  then  you  can 
simulate  much  more  extensively  and  easily 

Sooner  or  later,  someone  will  advise  you 
to  use  an  “ignorance”  prior,  i.e.,  a prior  that 
assumes  “eomplete  ignoranee  of  the  situa- 
tion”. Rejeet  that  adviee.  Proeeed  by  put- 
ting down  what  you  think  you  do  believe; 


TABLE  3-11 


PORTABLE  POWER  TOOL  INSULATION  TEST 


Condition 

#1 

#5 

#6 

(1) 

probability  of  failing  test 

0.9 

0.5 

0.2 

0.1 

0.03 

0.01 

(2) 

“before  test"  d-of-b 

0.1% 

n 1% 

QJ% 

n 7% 

9.5% 

4% 

(3) 

likelihood  of 
2-fail,  0-pass 

0.81 

0.25 

0.04 

0.01 

0.0009 

0.0001 

(4) 

"after  test"  d-of-b 

40% 

12% 

1 .9% 

3.9% 

42% 

0.2% 

(5) 

“before  test”  d-of-b 

1% 

1% 

1% 

1% 

95% 

1% 

(6) 

likelihood  of 
2-fail,  0-pass 

0.81 

0.25 

0.04 

0.01 

0.0009 

0.0001 

(7) 

“after  test"  d-of-b 

68% 

21% 

3.2% 

0.8% 

7% 

0.01% 

(8) 

"before  test"  d-of-b 

Wo 

1% 

1% 

Wo 

95% 

1% 

(9) 

likelihood  of 
0-fail,  2-pass 

0.01 

0.25 

0.64 

0.81 

0.94 

0.98 

(10) 

“after  test”  d-of-b 

0.01% 

0.3% 

0.7% 

0.9% 

97% 

1.1% 

d-of-b  - degree-of-belief,  i.e.,  Bayesian  probability 
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then  check  it  out  by  simulation;  revise  it 
and  check  again;  repeat  the  process  until  you 
are  satisfied  that  you  believe  what  you’ve 
recorded. 

Bayesian  analysis  is  tedious  and  time  con- 
suming when  it  is  done  right.  When  it  is 
done  wrong  (sloppily),  it  can  be  very  mis- 
leading. 


3-9.6  BAYES  FORMULAS,  CONTINUOUS 
RANDOM  VARIABLES 


pdfiip  I 0}  pdf{(l)}pdf{$  I 0}  (3-40) 

/ \ $}d4>  - 1 (3-41) 


where 


= value  of  the  continuous  ran- 
dom variable 

0 = estimate  of  d)  made  from  a 

new  test 


pdf  U]  - prior  pdf  assigned  to  d)  (before 
the  test) 

pdf  {010}  = likelihood  of  getting  the  test 
result  0 given  that  d)  is  the 
true  value 

pdf{4>\4>]  = new  pdf  assigned  to  0 after 
seeing  the  test  results 

implies  the  integral  over  the 
domain  of  d) 


3-9.7  CONJUGATE  PRIOR  DISTRIBU- 
TIONS 

When  the  events  and  probabilities  are  in 
the  form  of  a probability  distribution,  it  is 
mathematically  possible  to  find  a form  of 
prior  distribution  such  that  the  after-test 
(posterior)  distribution  has  the  same  para- 
metric form  (from  the  same  family  of  distribu- 
tions) as  the  prior;  see  Ref  25  or  other 
Bayesian  textbook. 

In  this  case  the  new  distribution  is  the 
same  as  the  old,  except  for  different  values 
of  the  parameters.  As  an  example,  for  the 
usual  failure  rate,  one  can  hypothesize  a 
prior  distribution  with  parameters  r and  T 
where  r = number  of  failures  and  T = total 
test  time.  The  estimate  of  A usually  used  is 
simply  r/r.  The  new  estimate  of  X is  made 
by  adding  the  new  increments  in  r and  T to 
the  old  \ alues-just  as  if  a classical  test  were 
being  run.  But,  in  Bayesian  statistics,  the 
old  r and  T don’t  have  to  be  actual  test  re- 
sults, they  ean  be  numbers  that  are  equivalent 
to  your  prior  degree-of-belief 

The  ealculational  simplieity  of  this  ap- 
proach has  much  appeal,  and  its  use  is  pop- 
ularized in  books  and  articles.  Before  using 
it,  compare  it  with  the  discrete  method  de- 
scribed earlier  in  this  paragraph.  Use  simu- 
lation to  find  the  consequences  of  your 
assumptions.  But  remember,  computational 
simplicity  is  not  the  purpose  of  a Bayesian 
analysis.  The  real  purpose  is  to  find  a 
reasonable  way  to  put  your  prior  knowledge 
to  work. 

Example  No.  30  illustrates  the  procedure. 

3-9.8  LIFE-TESTING 


Other  forms  of  the  equations  are  possible  for 
other  combinations  of  discrete  and  random 
variables  for  the  unknown  variable  and  the 
prior  information. 


Ref  29  shows  how  Bayesian  techniques 
can  be  applied  to  accept/reject  tests.  Be 
very  careful  in  using  them.  Simulate  exten- 
sively before  applying  any  in  an  important 
situation.  The  mathematics  is  deceptively 
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Example  No.  30 

Suppose  that  your  prior  degree-of- belief  about  a failure  rate  is  that  it  is  equiva- 
lent to  having  found  4 failures  in  2000  hr  of  testing  (Xg^j  = 1/2000-hr).  Suppose  the 
test  results  are  3 failures  in  1000  hr.  What  is  your  new  degree-of-belief?  Assume 
that  the  eonjugate  distribution  applies. 


Proeedure 

1.  Stateyour  prior  degree-of-belief. 

2.  Find  the  equivalent  failure  rate  and 
its  uneertainty.  See  par.  2-12  for 
formulas. 

3.  Find  the  failure  rate  and  its  un- 
eertainty, for  the  test  results  only. 

4.  Combine  the  prior  and  test  results, 
per  conjugate  distribution  theory. 


Example 

1.  r =4  , r =2000  hr. 

2.  Xg3(^^^o^  = 4/2000-hr 

= 2/1000-hr 

eoeff.  of  variation  = l/VT  = 50%. 

3-  Xgjj^^gg^  = 3/lOOO-hr 

eoeff.  of  variation  =l/'y3’  =58%. 

4.  '>^est,after  = ( 3 + 4)/(1000  hr  + 2000  hr) 
= 2.3/l000-hr. 

eoeff.  of  variation  = l/'/3  +4  =38%. 


The  prior  and  after-test  results  agree  reasonably  well.  Before  using  this  procedure, 
be  sure  to  simulate  possible  test  outcomes  extensively.  Example  No.  31  shows  what 
can  happen. 
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Example  No.  3 1 


Same  prior  degree-of-belief  as  Example  No.  30,  but  the  test  results  are  3 fail 
ures  in  10  hr.  What  is  your  new  degree-of-belief?  Assume  that  the  conjugate  dis- 
tribution applies.  Steps  land  2 are  the  same  as  in  Example  No.  30. 


Procedure 

3.  Find  the  failure  rate  and  its  un- 
certainty for  the  test  results  only. 


4.  Combine  the  prior  and  test  results, 
per  conjugate  distribution  theory. 


Example 
= 300/l000-hr, 

coeff.  of  variation  = 1/V3"  =58%. 

4-  Kst, after  = + 4)/(10  hr  + 1000  hr) 

= 7/1000-hr 

coeff.  of  variation  = 1/V3  + 4 = 38%. 


Now,  only  a fool  really  believes  that  the  failure  rate  is  7/lOOO-hr  (about  twice  the 
prior  belief).  Anyone  else  is  very  worried  about  those  test  results.  So,  the  prior 
degree-of-belief  was  most  inappropriate.  Perhaps  r = 0.4  and  T = 200  hr  would  have 
been  better  choices  for  the  prior  degree-of-belief. 

This  conjugate  method  of  choosing  prior  degree-of-belief  does  not  have  the  flexi- 
bility that  the  discrete  method  does,  and  it  is  easier  to  lead  oneself  astray. 
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easy  and  the  descriptions  are  pleasantly 
smooth.  Be  extremely  wary  about  a false 
sense  of  security.  Bayesian  techniques  are 
one  of  the  easiest  ways  known  to  mankind 
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CHAPTER  4 

TEST  MANAGEMENT  AND  PLANNING 


LIST  OF  SYMBOLS 

a - producer  risk 
|3  = consumer  risk 
0 = mean  failure  time 
00=  acceptable  value  of  8 
01=  unacceptable  value  of  8 


4-1  INTRODUCTION 

The  effectiveness  of  a reliability  test  pro- 
gram depends  on  the  thoroughness  with 
which  the  program  is  planned  (Refs.  1,  2, 
and  3).  Reliability  tests  often  represent 
millions  of  dollars  invested  in  test  manpower 
and  hardware,  and  require  careful  coordina- 
tion and  scheduling  of  hardware,  test  facili- 
ties, and  the  work  of  many  engineering  and 
technical  personnel.  Without  proper  planning, 
all  of  these  elements  may  not  be  available 
when  needed,  tests  may  not  be  performed  at 
the  right  time,  or  test  schedules  may  be 
rushed  and  haphazard. 

High-reliability  military  projects  often 
operate  on  very  short  time  schedules.  There- 
fore, test  planning  must  begin  very  early  so 
that  special  test  fixtures  can  be  designed  (on 
a calculated  risk  basis)  and  ready  when  the 
first  hardware  is  tested. 

Proposed  test  plans  must  be  available  to 
product  designers  so  that  test  points  can  be 
designed  into  the  system.  Good  test  planning 
may  reveal  that  the  cost  of  required  test 
procedures,  test  points,  and  test  manpower 


is  excessively  high  relative  to  the  cost  of  the 
item  tested.  It  may  then  be  necessary  to 
redesign  the  product. 

Coordination  between  responsible  groups 
is  important  in  the  planning  of  reliability 
testing.  A frequent  error  made  by  project 
managers  is  to  let  the  product  and  test  equip- 
ment designers  work  out  the  details  of  the 
acceptance  or  quality  testing  of  development 
hardware  without  consulting  reliability  and 
quality  assurance  personnel.  When  this  occurs, 
reliability  and  quality  assurance  may  be 
treated  inadequately.  In  a well  managed 
project,  reliability  and  quality  assurance 
engineers  plan  all  reliability  and  quality  test- 
ing with  inputs  provided  by  product  design 
groups.  This  approach  works  well  only  if 
the  reliability  group  begins  developing  the 
test  plans  concurrently  with  the  beginning 
of  product  design. 

Tests  must  be  planned  in  great  detail  and 
must  cover  all  elements  of  a test  program  in 
order  to  ensure  that  useful  data  are  produced. 
Test  planning  must  be  complete  enough  to 
permit  duplications,  and  omissions  to  be 
uncovered  and  cost  trade-offs  to  be  made. 

4-2  PROGRAM  PLANNING 

4-2.1  MANAGEMENT  ORGANIZATION 
FOR  TESTING 

The  overall  responsibility  for  planning  all 
test  programs  and  tests  should  be  assigned 
to  the  project  reliability  group.  This  ensures 
that  the  requirements  of  design,  quality 
assurance,  and  field  service  groups  can  be 
met  in  a coordinated  fashion  relating  to  reli- 
ability. 


4-1 


AMCP  706-198 


A reliability  test  planning  committee, 
chaired  by  a member  of  the  reliability  group, 
should  be  organized  and  begin  to  function  at 
the  start  of  the  project.  This  committee 
should  meet  on  a regular  basis  to  update  the 
overall  test-program  plan  as  changes  occur  on 
the  project.  This  committee  should  include 
members  of  reliability,  quality  assurance, 
product  design,  test  equipment  design,  pro- 
duction planning,  and  test  laboratories. 

The  representatives  of  each  technical 
speciality  make  contributions  to  the  test 
planning  group.  The  design  engineer  specifies 
the  items  and  attributes  to  be  tested  and  in- 
spected to  ensure  proper  operation  of  the 
system ; the  quality  assurance  representative 
specifies  the  attributes  to  be  tested  for 
process  and  quality  control;  the  reliability 
engineer  defines  the  reliability  verification 
requirements;  test  equipment  personnel  con- 
tribute heavily  to  the  test  program  planning. 
The  committee  estimates  costs  and  assesses 
the  overall  balance  between  risk  and  cost. 

The  basic  characteristics  of  development 
tests,  qualification  tests,  demonstration  tests, 
and  quality-assurance  tests  which  must  be 
considered  by  test  management  are  listed  in 
Tables  4-1  through  4-4  (Ref.  4).  Typical 
steps  which  must  be  followed  when  planning 
a reliability  test  are  summarized  in  Table  4-5 
and  information  categories  that  should  be 
included  in  a test  plan  are  described  in 
Table  4-6. 

4-2.2  SCHEDULES 

Reliability  test  planning  for  all  tests  should 
begin  at  the  very  start  of  a project  (Ref.  2). 
An  error  that  should  be  avoided  is  to  post- 
pone planning  for  system  demonstration 
tests  to  a point  later  in  the  project.  All  test 
planning  and  scheduling  should  begin  im- 
mediately. A preliminary  classification 
should  be  made  for  all  proposed  tests.  Test 
plans  should  be  recorded  in  spread-sheet 
format.  These  preliminary  plans  must  be 


revised  frequently  as  the  program  proceeds. 

Reliability-schedule  changes  can  result 
from  many  factors,  including  design  changes, 
changes  in  production  techniques  or  location, 
and  changes  resulting  from  information  de- 
rived from  design  reviews  and  preliminary 
testing.  Reliability  schedules  developed  early 
enough  in  the  program  will  be  flexible  enough 
to  incorporate  needed  changes  as  the  pro- 
gram progresses. 

4-2.3  DOCUMENTATION 

Much  documentation  is  required  to  plan 
a full  reliability-test  program.  The  reliability- 
test  plans  should  be  submitted  by  contractors 
as  part  of  their  proposals  to  the  Army  and, 
upon  approval,  be  included  in  the  contract  or 
detailed  equipment  specification.  As  devel- 
opment progresses,  the  plan  is  updated  as 
required. 

Table  4-6  lists  the  general  information 
categories  of  a test  plan.  Further  details  of 
a reliability -test  plan  are: 

1.  Description  of  Demonstration  Condi- 
tions. 

a.  Reliability  requirements.  The  values 
of  specified  MTBF  and  minimum  acceptable 
MTBF  or  other  measures  of  reliability.  See 
latest  version  of  Ref  7. 

b.  Test  purpose.  (1)  qualification  of 
new  or  redesigned  equipment;  (2)  sampling 
of  production  equipment;  and  (3)  longevity 
test 

c.  Equipment  identification.  A detailed 
description  of  the  equipment  under  test  with 
notes  about  necessary  auxiliary  equipment, 
failure  of  which  will  not  be  charged  to  the 
equipment  under  test 

d.  Demonstration  sites  and  facility  re- 
quirements 
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TABLE  4-1 

MANAGEMENT  ASPECTS  OF  DEVELOPMENT  TESTS'* 


1.  Purpose  of  Tests 

To  determine  physical  realizability,  to  determine  functional  capabilities,  to  establish  the  basic  design. 

2.  General  Description 

Developmenttests  are  usually  informal  exploratory  tests  designed  to  provide  fundamental  R&D  information 
about  a basic  design.  Nominal  environmental  levels  are  used  unless  the  test  is  oriented  specifically  to  check  for 
effects  at  environmental  extremes.  Sample  sizes  are  limited,  but  the  general  principles  of  good  experimental 
and  statistical  design  should  be  followed. 

3.  Examples  of  Specific  Types  of  Tests 


a. 

Design-Evaluation  Tests 

d. 

FunctionalTests 

b. 

Fatigue  Tests 

e. 

Breadboard  Tests 

c. 

Environmental  Tests 

f. 

Critical- Weakness  T ests 

g- 

Compatibility  Tests 

4.  Test  Scheduling 

Not  usually  specified  formally.  Design-engineeringgroup  establishes  schedules  to  meet  designdevelopment 
objectives.  Such  schedules  must  conform  to  development-program  milestones. 

5.  Test  Items 

Basic  materials,  off-the-shelf  parts  and  assemblies,  breadboard  models,  prototype  hardware. 

6.  Test  Documentation 

Engineeringtest  reports  and  analyses.  Performance,  failure,  and  maintainability  information  to  be  documented 
for  later  use  in  prediction,  evaluation,  and  testing  tasks. 

7.  Test  Follow-Up  Action 

Determinationof  design  feasibility  or  need  for  redesign.  Implementationof  test  information  in  further  design 
work.  Approval,  modification,  or  disapproval  of  design,  materials,  and  parts. 

8.  Rel lability /Maintainabi  lity  Provisions 

Proposed  materials  and  designs  to  yield  acceptable  R&M  performance  are  tested  on  limited  samples.  Material- 
fatigue  tests,  packaging  tests,  component-interactiontests,  accelerated  environmentaltests,  etc.,  are  examples. 
All  R&M  data  should  be  fully  documented  for  future  use  in  prediction,  assessment,  and  later  testing  activities. 


e.  Participating  agencies 
2.  Description  of  Test  Team: 


d.  Qualification,  quantity,  and  training 
of  test-team  personnel 


a.  Organization  3.  Description  of  Demonstration  Support 

Equipment: 

b.  Degree  of  participation  of  contractor 

and  procuring  activity  a.  Support  equipment 

c.  Assignment  of  specific  responsibilities  b.  Tools  and  test  equipment 
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TABLE  4-2 

MANAGEMENT  ASPECTS  OF  QUALIFICATION  TESTS'* 


1.  Purpose  of  Tests 

T 0 demonstrate  that  the  equipment  or  specified  components,  assemblies,  and  packages  meet  specified  perfor- 
mance requirements  under  stated  environmental  conditions. 

2.  General  Description 

Qualification  tests  are  formal  tests  conducted  according  to  procedures  specified  in  the  development  contract. 
Sample  size  is  small,  and  thus  inferential  analysis  is  limited. 

3.  Examples  of  Specific  Types  of  Tests 

a.  Preproduction  Tests 

b.  Environmental  Tests 

c.  Functional  Tests 

d.  Compatibility  Tests 

e.  Safety-marginTests 

f.  Continuity  Tests 
g Quality  Tests 

4.  Test  Scheduling 

Normally  contract  specified  be  performed  before  production  release. 

5.  Test  Items 

Pilot-line  items  produced,  to  the  extent  possible,  under  normal  production  methods. 

6.  Test  Documentation 

Detailedtest  requirements  and  procedures.  Test  resultsfully  documented,  including  analyses  and  conclusions 
concerning  design  qualification. 

7.  Test  Follow-Up  Action 

Approval  of  design  or  implementation  of  recommended  changes  to  correct  deficiencies.  Design  approval  permits 
production  release. 

8.  Pel  lability /Maintainability  Provisions 

Limited  reliability  and  maintainability  assessments  may  be  specified  during  design  qualification  tests,  such  as  a 
short  continuous-operation  test  or  tests  of  failure  diagnostic  routines.  Primary  applications  are  limited,  however, 
to  quality  testing  of  parts  and  processes. 


c.  Technical  publications 

d.  Spares  and  consumables 

e.  Safety  equipment 

f.  Calibration  support  requirements 


4.  Predemonstration-Phase  Schedule: 

a.  Assembly  of  test  team 

b.  Training 

c.  Preparation  facilities  and  support 
material 
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TABLE  4-3 

MANAGEMENT  ASPECTS  OF  DEMONSTRATION  TESTS'* 


1.  Purpose  of  Tests 

To  demonstrate  formally  that  operational  requirements  in  terms  of  effectiveness  parameters  such  as  reliability, 
maintainability,  and  design  capability  are  achieved. 

2.  General  Description 

Demonstration  tests  are  performed  on  the  major  end  items,  often  at  the  highest  system  level,  under  realistic 
operational  and  environmental  conditions.  Rules  are  specified  for  classifying  failures,  performing  repairs, 
allowing  design  changes,  etc.  Time  is  an  inherent  test  parameter.  The  test  design  is  usually  directed  towards 
providinga  specified  s-confidence  for  making  an  appropriate  decision. 

3.  Examples  of  Specific  Types  of  Tests 

a.  Reliability  Demonstration  d.  Life  Tests 

b.  Maintainability  Demonstration  e.  Longevity  Tests 

c.  Availability  Demonstration 

4.  Test  Scheduling 

Demonstration-test  schedules  are  normally  contract-specified.  They  generally  occur  before  full-scale  production 
but  after  initial  production,  when  test  samples  are  available. 

5.  Test  Items 

Production  hardware  at  major  end-item  level. 

6.  Test  Documentation 

Contract-specified  procedures  or  clause  requiringcontractorto  submit  complete  test  plan.  Test  results  fully 
documented,  including  analyses  and  conclusions  concerning  the  meeting  of  contract  goals. 

7.  Test  Follow-Up  Actions 

Acceptance  or  rejection  of  equipment  with  respectto  reliability,  maintainability,  and  effectiveness  goals.  Failure 
to  pass  demonstration  tests  will  require  appropriate  design  and  assurance  efforts  on  the  part  of  the  contractor. 

8.  Reliability/Maintainability  Provisions 

Demonstration  tests  are  specifically  designed  to  test  for  reliability,  maintainability,  and  associated  parametersat 
the  equipment  level.  Demonstrationtests  may  be  continued  throughout  the  production  cycle  on  samples  of 
equipment. 


5.  Description  of  Formal  Demonstration 
Test: 

a.  Performance  parameters  to  be 
measured 

b.  Performance  limits  for  defining  failure 

c.  Preventive-maintenance  measures  to 
be  performed 


d.  Definition  of  minor  failures  (not  to 
be  included  in  MTBF  analysis) 

e.  Test  equipment  to  be  used 

f Test  severity  levels  (see  par.  4-3.2) 

g.  Monitoring  test  equipment 

h.  Corrective-maintenance  procedures 
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TABLE  4 4 

MANAGEMENT  ASPECTS  OF  QUALITY-ASSURANCE  TESTS'* 


1.  Purpose  of  Tests 

Quality-assurancetests  are  performed  on  samples  of  incoming  or  outgoing  products  to  assure  that  materials, 
parts,  processes,  and  final  product  meet  the  established  performance  and  quality  levels. 

2.  General  Description 

Quality-assurancetests,  performed  during  the  production  phase,  includetwo  basic  types:  (1)  acceptance  tests  on 
samples  of  items,  to  accept  or  rejects  lot;  and  (2)  quality-control  tests  on  processes  and  machines,  to  ensure  that 
final  product  will  be  satisfactory.  The  tests  are  usually  designed  on  a statistical  basis  to  meet  specified  risk  levels. 

3.  E. camples  of  Specific  Types  of  Tests 

a.  Percent-defective  test 

b.  Parts-screeningtests 

c.  Production-control  tests 

d.  Part-lot  acceptance  tests 

4.  Test  Scheduling 

Quality-assurancetests  are  scheduledthroughoutthe  production  phase,  on  either  a lot-by-lot  basis  or  on  a con- 
tinuous basis,  depending  on  the  circumstances.  Scheduling  of  tests  can  depend  on  past  performance  of  the 
Contractor. 

5.  Test  Items 

Incoming  material,  machinesthat  process  the  material,  and  production  end  itemsat  all  levels. 

6.  Test  Follow-Up  Action 

Acceptance  or  rejection  of  processesor  production  lot.  Rework  of  rejected  lots  may  be  provided  for.  Many 
plans  tighten  risk  levels  of  poor  producers,  or  relax  levels  if  good  quality  is  maintained. 

7.  Reliability/Maintainability  Provisions 

A reliability  acceptance  test  on  go/no-go  items  is  a normal  quality-assurancetest.  Time  tests  for  testing  mean 
life  may  be  scheduled  periodically  but  may  not  be  as  extensive  as  the  initial  demonstration  tests.  Maintainability 
usually  is  tested  only  indirectly. 


e.  Incoming-inspection  tests 

f.  Storage  tests 

g.  Machine-weartests 

h.  Continuous-sampling  tests 


i.  Data-analysis  and  calculation  measures 

j.  Time  units  of  measurement 

k.  Type  and  schedule  of  report  and  log 
forms 

6.  Retest  Phase.  Provisional  retest  schedule. 

4-2.4  TEST  PROCEDURES 

Well  prepared  test  procedures  are  extremely 
important  for  an  effective  test  program.  De- 
tailed, formal,  and  controlled  test  procedures 


are  required  in  hi^  reliability  programs  and 
eomplex  weapon  system  programs. 

Test  procedures  deseribe  and  eontrol  (1) 
test  equipment  ealibration,  (2)  test  equipment 
proofing,  and  (3)  test  programming.  An 
elaboration  on  the  elements  follows: 

1.  Calibration.  Test  equipment  should  be 
ealibrated  against  standards  traceable  to  the 
National  Bureau  of  Standards.  Calibration 
operations  should  be  performed  at  the  inter- 
faees  between  the  test  equipment  and  the 
hardware  (at  the  test  leads).  All  test  equip- 
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TABLE  4-5 

STEPS  IN  OVERALL  TEST  PLANNING'* 

1.  Determine  test  requirements  and  objectives. 

2.  Review  existing  data  to  determine  if  any  existing 
requirements  can  be  met,  without  tests. 

3.  Reviews  preiiminary  list  of  pianned tests  to  de- 
termine whether  economies  can  be  reaiized  by 
combining  individuaitest  requirements. 

4.  Determine  the  necessary  tests. 

5.  Aiiocatetime,  funds,  and  effort  to  perform  these 
tests. 

6.  Deveioptest  specificationsat  an  appropriate  level, 
or  make  reference  to  applicable  sections  of  the 
system  specification  to  provide  direction  for  later 
development  of  test  specifications. 

7.  Assign  responsibilityfor  test  conduct,  monitoring, 
analysis,  and  integration. 

8.  Develop  review  and  approval  policies  for  test- 
reporting procedures  and  forms. 

9.  Develop  procedures  for  maintaining  test-status 
information  throughout  the  entire  program. 


ment  should  be  calibrated,  including  measur- 
ing equipment  and  environmental  test  cham- 
bers. At  the  start  of  a test,  calibrations 
should  be  checked  over  the  range  of  values 
expected. 

2.  Proofing.  The  test  procedures  must 
provide  techniques  for  demonstrating  that 
test  equipment  will  function  properly  when 
coupled  with  test  hardware.  These  procedures 
are  known  as  proofing.  They  can  be  used 
to  uncover  unanticipated  problems  such  as 
ground  loops  and  variations  in  input  condi- 
tions with  variations  in  loading.  Proofing  is 
very  important  the  first  time  a test  equip- 
ment design  is  used  with  a specific  set  of 
hardware. 


3.  Programming.  Test  programming  in- 
cludes all  the  minute  operations  required  of 
the  test  personnel  and  equipment.  Detailed 
data  sheets  that  define  all  the  required  input 
and  output  data  and  their  units  are  required. 
The  data  sheets  should  include  spaces  for 
recording  nontest  information— such  as  lab- 
oratory environmental  conditions,  date, 
hardware  configuration,  test  operator  and 
inspector  identification,  and  other  adminis- 
trative data.  Acceptance-test  accept/reject 
limits  also  should  be  included  on  the  data 
sheets. 

A system  of  controls  and  check-off  pro- 
cedures should  be  established  so  that  the  test 
plan  and  ehanges  are  reviewed  and  approved 
by  all  interested  parties. 

4-3  TEST  CRITERIA 

4-3.1  SELECTION  OF  ATTRIBUTES 

The  selection  of  attributes  for  testing 
depends  on  many  factors,  such  as  (Ref.  2): 

1.  The  need  to  demonstrate  that  a system 
is  functional 

2.  The  need  to  demonstrate  reliability 

3.  The  cost  of  testing 

4.  The  test  time  required 

5.  Equipment  and  personnel  available  for 
the  tests 

6.  Anny  requirements 

7.  Requirements  for  repair  part  inter- 
ehangeability 

8.  Desire  to  provide  optimum  process  and 
quality  control  and  to  assure  repeatability  of 
the  production  processes 

9.  Reliability  requirements 
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TABLE  4-G 

INFORMATION  CATEGORIES  FOR  A DEVELOPMENTAL  TESTING  PLAN^ 


Information 

Category  Description 


Quantity  Number  of  test  specimens  to  be  built  or  purchased 


Dates  of  delivery  of  test  specimens  and  test  equipments;  dates  on  which  testing  is  to 
commence  and  conclude 


Test  Duration 
Test  Type 

Environments 

Test  Procedures 
Test  Location 


Expected  length  of  time  testing  is  to  continue  on  an  item 

Examples:  test  to  failure,  nondestructivetest,  life  test,  etc. 

Stressesto  be  imposed  and  cycling  rates;  parametersto  be  monitored;  applicable 
specifications(e.g.,  military  or  detailed  equipment  specifications) 

Applicable  specifications  (e.g.,  military);  frequency  and  type  of  monitoring  required; 
definitions  of  failure  or  satisfactory  operation;  repair  actions  to  be  allowed 

Place(s)  where  testing  is  to  be  performed 


Cost  of  Testing 


Costs  of  test  specimens  and  special  test  equipment  needed;  total  cost  of  test 


Frequency  of  interim  reports;  types  of  analyses  to  be  prepared;  data  forms  to  be  em- 
Reporting  ployed  and  their  distribution;  allowable  delay  between  test  completion  and  issuance 

of  final  test  report;  distribution  of  test  reports 


Specific  personnel  (or  group)  obligations  for  preparation  and  design  of  test  plans  and 
Responsibilities  procedures,  procurement  of  test  specimens  and  test  equipment,  operation  of  tests, 

analysis  of  test  data  and  results,  and  preparation  of  interim  and  final  reports 

Reliability  Requirement  Statement  of  reliability  level  to  which  equipmentwill  be  tested 


Maintainability 

Requirement 


Statement  of  maintainability  level  to  which  equipmentwill  be  tested 


10.  The  procurement  cost  and  the  cost  of 
replacement. 

It  is  not  possible  to  test  all  attributes  of  a 
component  or  a system.  Therefore,  only  a 
subset  of  the  attributes  describing  a system 
can  be  tested.  The  process  of  selecting  those 
attributes  to  be  tested  requires  the  exercise 
of  a great  deal  c;  judgment.  The  committee 
approach  can  be  very  useful. 


The  process  of  developing  a list  of  attributes 
for  test  is  simplified  if  a standard  classification 
procedure  is  used.  A system  of  classification 
of  defects  and  classification  of  characteristics 
was  developed  for  use  by  the  Army  and  Navy 
(Ref  5).  In  this  system,  each  attribute  is 
classified  critical,  major,  or  minor,  in  accor- 
dance with  its  effect  on  coordination,  life, 
interchangeability,  function,  and  safety.  With 
such  a classification  system  in  operation. 
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attribute  classification  is  standardized  from 
project  to  project,  from  item  to  item,  and 
from  test  program  to  test  program,  within  a 
project.  The  use  of  a standard  classification 
system  simplifies  failure  diagnosis,  corrective 
action,  inspection,  and  design-change  control, 
,and  provides  baseline  definitions  for  the  reli- 
ability incentive  in  incentive  contracts.  The 
most  direct  benefit  of  test  planning  is  that 
subjective  selection  of  attributes  is  replaced 
by  objective  application  of  an  agreed-upon 
set  of  ground  rules. 

4-3.2  TEST  CRITERIA  FOR  RELIABILITY 
DEMONSTRATION  PER  MIL-STD- 
781"  (REF.  6) 

4-3. 2.1  Test  Levels 

MlL-STD-781  has  10  different  test  levels 
that  specify  conditions  of  temperature  and 
temperature  cycling,  input  voltage  cycling, 
on-off  cycling,  and  vibration.  Table  4-7 
summarizes  the  test  levels.  These  levels 
should  be  considered  minimum  requirements, 
and  appropriate  modifications  should  be 
made  to  meet  more  stringent  conditions. 

The  following  considerations  should  apply: 

1 . The  test  level  should  be  severe  enough 
to  equal  the  anticipated  operational  stress. 

2.  The  test  level  must  be  severe  enough 
to  uncover  defective  parts  or  workmanship. 

3.  The  test  level  should  approach  or  equal 
design  extremes  but  should  not  exceed  basic 
design  specifications  to  such  an  extent  that 
non-relevant  failure  modes  become  important. 

4-3.2. 2 Test  Criteria 

MlL-STD-78 1 provides  five  types  of  tests: 

(1 ) standard  sequential  tests;  ('ij  short-run, 
high-risk  sequential  tesb,  (3)  fixed-length 
tests;  (4)  longevity  tests;  and  (5)  all  equip- 
ment screening  test.  There  are  29  individual 
test  plans.  Their  risk  characteristics  are 
summarized  in  Table  4-8. 


Generally,  the  standard  sequential  plans 
n through  VI)  offer  acceptable  risk  levels 
at  minimum  test  time  for  development  tests. 
The  high-risk  sequential  tests  (plans  Vll,  Vlll, 
IX)  should  be  used  only  if  test  resources  are 
very  limited  and  the  high  risks  of  incorrect 
decision  are  acceptable.  The  fixed-length 
tests  (X  through  XXV)  are  generally  used 
for  production  sampling  since  the  accept  test 
time  is  fixed,  leading  to  easier  scheduling, 
and  since,  generally,  more  test  equipment  is 
available  for  production  testing  than  for 
developmental  testing.  Plan  XXVI  (develop- 
ment) and  XXVII  (production)  specify  a 
maximum  test  time  of  500  hr  on  each 
sample  equipment.  Decisions  can  be  made 
after  a period  equal  to  3 times  the  specified 
MTBF  (if  such  a period  is  less  than  500  hr). 

The  longevity  test  is  used  for  testing  the 
total  operational  life  of  the  equipment.  At 
least  two  equipments  must  be  tested  for  a 
time  equal  to  the  specified  longevity.  Time 
aceumulated  on  the  demonstration  test  may 
be  applied  to  the  longevity  test.  If  there  is 
no  longevity  requirement,  each  equipment  is 
tested  for  2000  hr.  No  accept  criteria  are 
given,  but  all  failures  and  patterns  are  ana- 
lyzed to  determine  if  the  longevity  goal  is 
satisfied. 

4-3. 2.3  Test  Performance  and  Evaluation 

The  following  items  are  important: 

1.  Sample  Size.  Generally  at  least  3 
equipments  are  tested,  but  the  actual  num- 
ber depends  on  the  purpose  of  the  test  and 
the  lot  size.  See  Ref  6. 

2.  Evaluation  Criteria.  MIL- STD-78 1 pre- 
sents the  complete  accept-reject  criteria  for 
each  of  its  29  test  plans  (i.e.,  the  ones  shown 
in  Table  4-8). 

3.  Test  Procedure.  MIL- STD-78  Ipre- 


*AU  references  to  MEL-STD-781  are  to  version  B,  Change 
1,  July  1969  revision. 
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TABLE  4-7 

SUMMARY  OF  TCST  LEVELS 
(Adapted  from  Ref.  6) 


Test 

Level 

Temperature 

Temperature 
Cycling 
See  Note 

Vibration 
See  Note 

Equipment 
On-Off 
Cycling 
See  Note 

A 

25±5 

None 

1 

2 

A-1 

25+5 

None 

None 

None 

B 

40±5 

None 

1 

2 

C 

50+5  /-O 

None 

1 

2 

D 

65±5 

None 

1 

2 

E 

-54  to  55 

5 

1 

6 

F 

-54  to  71 

5 

1 

6 

G 

-54  to  95 

5 

1 

6 

H 

-65  to  71 

5 

1 

6 

I 

-54  to  125 

5 

1 

6 

All 

See  Note  3 for  Input  Voltage, 

and  Note  4 for 

Input  Voltage 

Cycling. 


Notes 

1.  2.2G  ± 10%peak  acceleration  value  at  any  nonresonant  frequency  between  20 
and  60  Hz  measured  at  the  mounting  points  on  the  equipment.  The  duration 
of  vibration  shall  be  at  least  10  minduringeaoh  hour  of  equipment  operating 
time. 

2.  Turn  on  and  let  temperature  stabilize,  hold  for  3 hr,  then  turn  off  and  let 
temperature  stabilize.  This  cycle  shall  continue  throughout  the  test. 

3.  Nominal  specified  voltage  plus  5%,  minus  2%. 

4.  V\/hen  so  directed  by  the  procuringactivity,  voltage  cycling  shall  be  accomplished 
as  follows:  The  input  voltage  shall  be  maintainedat  1 10%nominal  for  one-third 
of  the  equipment  "on"  cycle,  at  the  nominal  value  for  the  second  one-third  of 
the  equipment  "on"  cycle,  and  at  90%for  the  final  one-third  of  the  equipment 
"on"  cycle.  This  cycling  procedureis  to  be  repeated  continuously  throughout 
the  reliability  test. 

5.  Temperature  cycling  shall  be:  time  to  stabilize  at  low  temperaturefollowed 
by  time  to  stabilize  at  the  high  temperature,  plus  2 hr. 

6.  Equipment  off  during  coolingcycleand  on  during  heating  cycle. 


sents  procedural  guidelines  for  selecting  and 
installing  equipment,  initiating  tests,  heating 
and  eooling  eyeles,  repeated  testing,  deter- 
mining eomplianee,  failure  aetions  and  failure 
eategories,  failure  analysis  and  information, 
verifying  repair,  preventive  maintenanee  and 
eorreetive  aetion,  restoration  of  failed  equip- 


ment, test  records  and  reports,  and  final 
reports. 

4-4  TYPICAL  ARMY  SCHEDULE 

Fig.  4-1  shows  the  test  support  for  mate- 
rial acquisition. 
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TABLE  4-8 

SUMMARY  OF  RISK  AND  TIME  CHARACTERISTICS  FOR  INDIVIDUAL  TEST 

PLANS  FOR  CONSTANT  FAILURE-RATE  ECUIPMENT  (ADAPTED  FROM  Ref.  6) ' 

6q  = true  mean  life  at  producer  risk  point 
0,  = true  mean  life  at  consumer  risk  point 


Nominal  Nominal 


Test 

Plan 

Producer 
Risk  a, 

% 

Consumer 

R isk  0, 

% 

Discrimina- 
tion Ratio 

Approximate 
Maximum  Dura- 

Approximate  Ex- 
pected Test  Time 
to  Accept  if  0=00 

Number 

actual  given  in  ( ) 

OolOi 

tion  (units of  0o) 

(units  of  0q) 

Standard  Tests 


I 

II 

III 

IV 
IVa 

V 

VI 

ID  (11.5) 
20  (22.7) 
10  (12.8) 
20  (22.3) 
20  (18.2) 
10  (11.1) 
10  (12.4) 

10  (12.5) 
20  (23.2) 
10  (12.8) 
20  (22.5) 
20  (19.2) 
10(10.9) 
10  (13.0) 

L5 

1.5 

2.0 

2.0 

3.0 

3.0 

5.0 

33.0 

14.6 

10.3 

4.9 

1.5 

3.5 
1.3 

17.3 

7.6 

5.1 

2.4 

11 

2.0 

0.64 

Short-Run,  High-Risk  Sequential  T ests 

VII 

30  (31.9) 

30  (32.8) 

1.5 

4.5 

3.4 

VIII 

30  (29.3) 

30  (29.9) 

2.0 

2.3 

1.3 

IX 

35  (36.3) 

40(39.7) 

1.25 

8.3 

5,0 

Fixed-Length  Tests 

Acceptance 

Number 

X 

10 

10 

1.25 

100 

111 

XI 

10 

20 

1.25 

72 

82 

XI 1 

20 

20 

1.25 

44 

49 

XIII 

30 

30 

1.25 

15 

16 

XIV 

10 

10 

1.5 

30 

36 

XV 

10 

20 

1.5 

20 

25 

XVI 

20 

20 

1.5 

14 

17 

XVI  1 

30 

30 

1.5 

5.3 

6 

XVIII 

10 

10 

2.0 

9.4 

13 

XIX 

10 

20 

2.0 

6.2 

9 

XX 

20 

20 

2.0 

3.9 

5 

XXI 

20 

30 

2.0 

1.8 

2 

XXII 

10 

10 

3.0 

3.1 

5 

XXIII 

10 

20 

3.0 

1.8 

3 

XXIV 

20 

20 

3.0 

1.5 

2 

XXV 

30 

30 

3.0 

0.37 

9 

XXVI 

N/A 

N/A 

N/A 

3.0 

XXVI 1 

N/A 

N/A 

N/A 

3.0 

XXVIII 

longevitytest  plan* 

XXIX 

all  equipment  screening  test* 

*See  Ref.  6 for  details. 
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Figure  4- 1.  Test  Support  of  Materiel  Acquisition^ 
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The  Department  of  Army  (DA)  and  US  Army 
Materiel  Command  (AMC)  continually  up- 
date their  practices  and  schedules  in  order 
that  learning  from  past  experience  and  pre- 
sent thinking  can  improve  the  materiel  ac- 
quisition process  in  the  future.  It  is  not 


feasible  to  list  current  directives  and  think- 
ing since  they  change  from  time  to  time. 
Therefore,  one  should  contact  the  appropri- 
ate Directorates  of  AMC  for  current  informa- 
tion. 
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CHAPTER  5 

INTEGRATED  RELIABILITY  DATA  SYSTEM 


5-1  INTRODUCTION 

An  integrated  reliability  data  system  can 
be  used  to  provide  project  managers  and 
engineers  with  the  data  that  they  need  to 
determine  the  reliability  achieved  by  the  sys- 
tem and  its  component  parts.  If  provided 
in  a timely  manner,  this  information  can  be 
used  for  effective  planning,  review,  and  con- 
trol of  actions  related  to  system  reliability. 

The  data  system  should  be  established  for 
collecting,  analyzing,  and  recording  data  on 
all  failures  that  occur  during  system  devel- 
opment and  operation.  The  system  must 
provide  data  that  can  be  used  to  estimate 
reliability  and  from  which  needed  corrective 
action  can  be  determined.  Computer  pro- 
grams that  permit  the  printing  of  reliability 
status  reports  should  be  developed  or  ac- 
quired as  part  of  the  integrated  reliability 
data  system. 

The  reliability  data  system  will  be  useful 
to  the  designer  in  providing  a complete  fail- 
ure history  of  the  system  and  its  constituent 
parts  in  some  easily  interpreted  form.  This 
history  should  include  an  indication  of  the 
specific  mode  of  failure,  the  cause  of  each 
failure,  and  a record  of  the  effectiveness  of 
each  corrective  action. 

The  reliability  data  system  also  must  serve 
management.  Management  must  be  provided 
with  summary  reports  describing  the  current 
reliability  status  of  the  system.  Suppliers  of 
components  must  be  evaluated  continuously 
to  ensure  that  their  products  have  adequate 
reliability.  Therefore,  the  data  system  must 
provide  a current  record  of  the  failure  his- 
tory attributable  to  each  vendor. 


Procedures  for  data  accumulation  and  re- 
duction must  be  developed  and  standardized. 
These  standard  procedures  must  provide  for 
the  collection  of  data  - such  as  identifying 
information,  environmental  conditions, 
operating  hours  or  cycles,  and  the  descrip- 
tion of  hardware  failures  on  each  test  per- 
formed. The  system  also  should  be  struc- 
tured to  make  use  of  data  recorded  on 
failures  occurring  at  times  other  than  the 
reliability  tests. 

The  integrated  data  system  can  be  used  to 
handle,  process,  and  integrate  all  data  ob- 
tained from  testing,  inspection,  and  failure- 
trouble  reporting.  These  data  can  be  used 
for  reliability  analysis  and  reporting,  assess- 
ment of  equipment  readiness,  and  a variety 
of  other  purposes. 

A computer  data  bank  of  accumulated 
and  summarized  reliability  data  must  be 
maintained  and  updated  periodically.  These 
data  can  be  processed  to  produce  reliability 
parameters  for  components,  equipments,  and 
subsystems.  These  reports  can  be  structured 
to  present  a listing  of  troublesome  items 
causing  the  most  serious  reliability  problems. 
These  lists  then  can  be  distributed  to  cogni- 
zant Anny  and  contractor  engineers  and 
managers. 

The  reliability  data  system  for  a weapon 
system  developed  by  the  Army  should  be 
usable  by  both  contractor  and  Army  person- 
nel. During  research,  development,  and 
engineering  design,  the  data  system  provides 
the  information  required  for  reliability  de- 
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sign  decisions.  Later,  when  the  system  be- 
comes operational,  the  data  system  can  be 
used  by  the  Army  to  collect  field  reliability 
data  (if  so  desired)  which  will  provide  the 
basis  for  system  modifications  and  changes 
in  maintenance  and  supply  concepts.  The 
DA  operates  several  data  banks;  see  Part 
Two,  App.  B for  a listing  of  some  of  the 
data  bank/retrieval  systems.  The  policy 
in  regard  to  data  banks  changes  occasionally. 
Check  the  latest  directives  in  this  regard. 

5-2  STRUCTURE  OF  A RELIABILITY 
DATA  SYSTEM 

A reliability  data  system  consists  of  a 
data  bank,  a set  of  computer  programs,  and 
computer  hardware.  The  data  bank  is  a sys- 
tematic set  of  data  describing  the  reliability 
characteristics  of  selected  component  parts 
and  subsystems  as  well  as  the  system  as  a 
whole.  The  information  in  the  data  bank 
can  be  made  available  in  printed  form  in  a 
variety  of  formats,  using  report  generator 
programs.  The  information  in  the  data  bank 
also  can  be  manipulated  to  produce  reports 
required  by  systems  management  and  engi- 
neering personnel.  The  use  of  a single  uni- 
fied data  base  simplifies  the  problems  of  file 
searching,  report  generation,  and  adding  new 
data. 

In  this  paragraph,  the  following  areas  will 
be  discussed:  (1)  organizing  and  addressing 
data,  and  data  format,  (2)  programs  for  data 
bank  establishment  and  updating,  (3)  ex- 
traction routines,  and  (4)  data  bank  oper- 
ation. 

5-2.1  ORGANIZING  AND  ADDRESSING 
DATA 

The  information  in  the  data  bank  must  be 
organized  in  a systematic  manner,  so  that  it 
is  uniquely  addressable  and  readily  accessible. 
The  information  retrieval  programs  should 
permit  standard  reports  to  be  generated  and 
specific  questions  to  be  answered  on  query. 


Once  a suitable  organizational  structure  for 
data  has  been  determined,  a corresponding 
address  structure  must  also  be  devised  so 
that  an  address  is  available  to  designate  uni- 
quely any  category  in  the  organizational 
hierarchy. 

The  data  elements  to  be  stored  in  the  sys- 
tem must  be  carefully  defined  and  structured 
prior  to  establishing  the  files.  A typical  data 
element  structure  is  given  in  Table  5-1  (Ref. 
3).  This  is  suitable  only  for  testing  up  to, 
but  not  including,  ordinary  field  use.  Stan- 
dard DA  procedures  are  to  be  used  for  field 
failure  reporting  (Refs.  1,  2). 

The  classification  system  should  permit 
reliability  data  to  be  organized  by  system, 
subsystem,  assembly,  subassembly,  and  low- 
est replaceable  unit.  A numerical  coding 
scheme  should  be  developed  which  permits 
the  system  hierarchical  structure  to  be  des- 
eribed. 

The  coding  system  also  must  permit  fail- 
ure modes  and  test  environments  to  be  des- 
eribed.  All  environmental  factors  to  be 
applied  during  the  reliability  and  environ- 
mental tests,  as  well  as  those  factors  expect- 
ed to  be  encountered  in  the  field,  must  be 
included  in  the  system.  Fig.  5-1  (Ref.  4) 
shows  a typical  computer  printout  sum- 
marizing a typical  set  of  environmental 
factors.  As  the  project  progresses,  this  list 
can  be  expanded. 

The  data  formats  most  suitable  for  com- 
puter manipulation  may  not  coincide  with 
fonnats  that  are  easy  for  the  test  engineers 
to  use:  therefore,  the  formats  for  data  entry 
may  be  somewhat  different  than  those  used 
by  test  engineers.  The  way  in  which  data 
reformatting  is  accomplished  depends  on  the 
system.  For  example,  one  approach  is  to 
reorganize  the  data  when  entering  it  onto 
data-entry  coding  forms.  Or,  the  data  can 
be  entered  directly  from  test  forms  (after 
error  checking)  to  be  reformatted  by  the 
computer. 
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TABLE  5-1 

DATA  ELEMENT  DEFINITIONS  AND  IDENTIFICATION  OF  SYSTEM  SOURCES  OF 
DATA  APPLICABLE  TO  EACH  DATA  ELEMENT  DESCRIPTOR^ 

Data  Elements  Definition  cr  Explanation 

ITEM  DESCRIPTORS 
(1)  Item  Identification 

FSN/Bureau  Plan  and  Piece  Federal  stock  number,  bureau  piece  number,  or  drawing  number  of 

Number,  Drawing  Number  system  equipment 

CID/APL/AN  Number  Component  identification  number,  Allowance-Parts-Lists  number, 

Army-Navy  Number  of  equipment  in  which  replacement  part  was  used 

System/Equi  pment  Name  Noun  name  identification  of  system/equipment  at  the  highest  assembly 

level 

System/Equi  pment  Part  Federal  stock  number  (FSN)  at  the  highest  assembly  level 

Number  or  Identification  Code 

System/ Equipment  Serial  Manufacturer's  serial  number  assigned  to  the  system/equipment 

Number 

Vehicle  Serial  Number  Serial  number  of  missile,  aircraft  or  other  vehicle  in  which  failed  part 

was  located 

Assembly  Name  Noun  name  identification  of  the  assembly  in  which  the  failed  part  is 

located 

Assembly  Part  Number  or  Federal  stock  number  (FSN)  of  the  assembly 

Identification  Code 

Assembly  Serial  Number  Manufacturer's  serial  number  of  the  assembly  containing  failed  part 

Subassembly  Name  Noun  name  identification  of  the  subassembly  where  the  failed  part 

is  located 

Subassembly  Part  Number  Federal  stock  number  (FSN)  of  the  subassembly  containing  failed 

or  Identification  Code  part 

Subassembly  Serial  Number  Manufacturer's  serial  number  of  the  subassembly  containing  the  failed 

part 

Subassembly  Symbol/Desig-  Manufacturer's  drawing  reference,  circuit,  symbol,  or  other  identifica- 

nation  tion  of  the  subassembly  containing  failed  part 

Failed  Part/Item  Number  Federal  stock  number  (FSN)  of  the  failed  part 

Failed  Part/Item  Name  Noun  name  identification  of  the  failed  part 

Failed  Part/Item  Serial  Manufacturer's  serial  numberof  the  failed  part  or  item 

Number 
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TABLE  5-1  (Cont'd) 

DATA  ELEMENT  DEFINITIONS  AND  IDENTIFICATION  OF  SYSTEM  SOURCES  OF 
DATA  APPLICABLE  TO  EACH  DATA  ELEMENT  DESCRIPTOR^ 

Data  Elements  Del or i 

ITEM  DESCRIPTORS  (Cont'd) 

Failed  Part/Item  Symbol  Manufacturer's  drawing  reference,  circuit,  symbol  or  other  identifi- 

Designation  or  Code  cation  of  failed  part  or  item 

Federal  Stock  Number  Federal  stock  number  (FSN)  of  failed  parts  of  items  removed  from 

(Removed  Item)  equipment 

Part  Number  (Installed  Item)  Part  number  or  federal  stock  number  of  replacement  part  or  item 

Serial  Number  (Installed  Item)  Manufacturer's  serial  number  of  replacement  part  or  item 

(2)  Hardware  Location  and 
Source  Identification: 

Location  (Geographic)  Location  of  the  equipment  that  is  the  source  of  the  data 

Geographic  location  of  equipment  when  part  failed 

Location  (Physical)  Location  of  failed  part  in  the  equipment,  or  name  of  assembly  If  more 

than  one  of  the  same  part  is  used 

Installed  in  A/C  Arresting  Model  description  and  serial  number  of  equipment  In  the  categories 

Gear,  Catapult,  or  Support  where  failed  part  was  located 

Equipment 

Equipment  Contractor  Name  of  contractor  or  manufacturer  of  equipment 

System/ Equipment  Manu-  Noun  name  identification  of  prime  manufacturer 

facturer 

Assembly  Manufacturer  Noun  name  identification  of  manufacturer  of  assembly  containing 

failed  part 

Subassembly  Manufacturer  Noun  name  identification  of  manufacturer  of  subassembly  containing 

failed  part 

Failed  Part/Item  Manu-  Noun  name  identification  of  manufacturer  of  the  failed  part  or  item 

facturer 

Manufacturer  Name  or  Code  Noun  name  identification  of  manufacturer  of  replacement  assembly 

(Component/Assembly 

Replacements) 

Manufacturer  Name  or  Code  Noun  name  identification  of  manufacturer  of  replacement  part  of  item 

(installed  Item) 
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TABLE  5-1  (Cont'd) 

DATA  ELEMENT  DEFINITIONS  AND  IDENTIFICATION  OF  SYSTEM  SOURCES  OF 
DATA  APPLICABLE  TO  EACH  DATA  ELEMENT  DESCRIPTOR® 

Data  Elements  Definition  or  Explanation 

ITEM  DESCRIPTORS  (Cont'd) 

Contract  Number  Number  identification  of  contract  under  which  the  system/equipment 

containing  failed  part  was  procured 

Production  Status  Development,  preproduction,  or  operational  at  the  tim^e  failure  occurred 

RELIABILITY  DESCRIPTORS 

(1 ) Time  and  Number  Data 
Elements: 

Date  Form  Submitted  or  Calendar  date  form  is  submitted  or  calendar  date  report  is  completed 

Date  of  Report 

Date  of  Failure  Calendar  date  failure  occurred  or  malfunction  first  observed 

Time  of  Failure  Clock  time  failure  occurred  or  was  first  observed 

Date  of  Last  Failure  Calendar  data  of  last  failure  of  any  kind  on  the  equipment 

Total  System/Equipment  Total  clock  hours  of  operating  time  logged  on  the  equipment  when  the 

Operating  Time  failure  occurred 

Operating  Hours  on  Failed  Total  clock  hours  of  operating  time  accumulated  on  the  failed  part 

Part 

Time  Meter  Readings  (Log  Clock  hours  of  operating  time  on  the  equipment  — from  meters  or  log 

Book  Time/Mal functional  book  — when  failure  occurred 

Equipment) 

Operating  Hours  Since  Total  operating  hours  on  failed  equipment  since  the  last  part  failure  of 

Last  Component  Failure  any  kind 

Miles  Mileagefrom  odometers  mounted  on  the  equipment  where  failed  part 

is  located 

Rounds  T otal  number  of  rounds  fired 

Starts  Total  number  of  hot  starts  for  jets  or  turbine  engines 

Time  Since  New  (Vintage)  Calendar  years  and  months  since  the  equipment  was  installed  in  a new 

of  Equipment  (Year  of  condition  for  operational  use 

Operating  Status) 

Equipment  Downtime  The  total  time  during  which  the  equipment  was  not  in  acceptable 

operating  condition 
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TABLE  5-1  (Cont'd) 


DATA  ELEMENT  DEFINITIONS  AND  IDENTIFICATION  OF  SYSTEM  SOURCES  OF 
DATA  APPLICABLE  TO  EACH  DATA  ELEMENT  DESCRIPTOR^ 


Data  Elements 

RELIABILITY  DESCRIPTORS  (Cont'd) 
Total  Systems  (Number) 

System  Mean  Time 

Total  Number  of  Failures 

Number  of  Failures  (Each  Mode) 


Number  of  Failures  (Each 
Part) 

Failed  Material  (Quantity) 

Estimated  Percent  of 
Total  Failures  Reported 

Failure  Rate 


Part/Component  Population 
Date  and  Duration  of  Test 

(2)  Circumstantial  Data 
Elements: 

Identification  of  Test  or 
Activity  in  Progress 

Status  of  Equipment 

Intended  Use 

Environment 

Special  Environmental 
Conditions 

Failure  Reporting  System 


Definition  or  Explanation 

Total  numbers  of  equipments  in  operation  at  the  reporting  activity 

Total  measured  operating  time  divided  by  the  total  number  of  failures 

The  sum  of  all  failures  involved  in  an  equipment  malfunction 

Total  number  of  failures  in  each  failure  mode  for  each  equipment 
malfunction 

Total  number  of  parts  as  related  to  total  number  consumed  in  making 
the  repairs 

Total  number  of  parts  replaced  during  each  equipment  malfunction 
Estimated  percent  of  all  failures  reported  during  a given  report  period 


At  any  point  in  the  life  of  material,  the  incremental  change  in  the 
number  failures  (change  in  the  measure  of  life) 

T otal  number  of  parts  or  components  in  a given  universe  under  study 

Calendar  date  of  test  where  failure  occurred  and  duration  in  hours  to 
the  time  of  failure 


Conditions  of  test,  type  of  test,  test  data,  and  duration 

Circle  an  arrow  to  indicate  status  of  equipment  prior  to  incorporating 
specified  technical  directives 

Intended  end  ise  environment  by  installation  environment 

Environment  when  failure  occurred 

Special  environmental  conditions  when  failure  occurred 


Controlled  or  uncontrolled  system,  method  of  reporting,  personnel 
reporting,  definition  of  failure,  and  estimated  percent  of  total 
failures  reported 
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TABLE  5-1  (Cont'd) 


DATA  ELEMENT  DEFINITIONS  AND  IDENTIFICATION  OF  SYSTEM  SOURCES  OF 
DATA  APPLICABLE  TO  EACH  DATA  ELEMENT  DESCRIPTOR^ 


Data  Elements 

Definition  or  Explanation 

RELIABILITY  DESCRIPTORS tCont'dt 
Type  of  Report 

Check-off  list  of  six  classes  of  reports;  approximate  block  is  checked 
to  indicate  type  of  report 

Report  Priority 

The  assignment  of  priority  classificationssuch  as  "Urgent" and 
"Flight  Safety"to  the  report 

Equipment  Status  After 
Failure 

Equipment  performance  after  failure  occurred 

Type  of  Failure 
(Critical/Major/Minor) 

The  one  code,  out  of  three,  best  describing  the  type  of  failure 

Primary  or  Secondary 
Failure 

To  indicate  a prime  failure  or  a failure  caused  by  the  failure  of  another 
part 

Operational  Condition 

One  of  three  classificationsdescribing  effect  of  failure  on  equipment 
operation 

Discovered  (Code/Time/ 
Situation) 

A single-letter  code  which  identifies  when  malfunction  of  the  equip- 
ment or  component  was  discovered 

Symptoms  (Description  of 
Failure  and  Discovery/ 
Symptom  Code) 

Description  of  any  obvious  reason  for  failure  or  abnormal  manifesta- 
tions in  operation  at  the  time  of  malfunction 

Malfunction  Description 

Describes  the  trouble  in  the  system,  component  identified  in  the 
work-unit  code  block 

Percent  of  Rating 
(Voltage/Power,  etc.) 

Percent  of  rated  load  for  the  part  application  under  operating- 
stress  conditions 

Description/Remarks 
(Additional  Information) 

Any  additional  descriptions,  remarks,  or  suggestions  related  to  the 
malfunction 

Part  Condition  (Failed 
Part) 

A three-digit  number  code  describing  residual  condition  of  failed 
part  by  code  system 

Malfunction/Failure  Cause 

Cause  of  malfunction  or  failure 

Failure  Code 

Enter  code  from  "part  condition"  which  best  describes  residual  con- 
dition; may  be  physically  observed  or  apparent  during  test  or  operation 

How  Malfunctioned 

A three-digit  number  used  to  provide  a description  of  the  trouble 
on  or  in  the  equipment  or  the  component  listed  in  the  FSN  block 
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TABLE  5-1  (Cont'd) 


DATA  ELEMENT  DEFINITIONS  AND  IDENTIFICATION  OF  SYSTEM  SOURCES  OF 
DATA  APPLICABLE  TO  EACH  DATA  ELEMENT  DESCRIPTOR® 


Data  Elements 


Definition  or  Explanation 


COST  ACCOUNTING  DESCRIPTORS: 
Contract  Number 

Total  Systems  (Number) 

Total  Number  of  Failures 

Number  of  Failures  (Each 
Mode) 

Number  of  Failures  (Each 
Part) 

Failed  Material  (Quantity) 

Unit  Cost 


Estimated  Percent  of  T otal 
Failures  Reported 

Failure  Rate 


Part/Component  Population 
Maintenance-  Total  Man-Hours 
Maintenance  Time  - Diagnosis 


Number  identification  of  contract  under  which  the  system/equipment 
containing  failed  part  was  procured 

Total  numbers  of  equipments  in  operation  at  the  reporting  activity 

The  sum  of  all  failures  involved  in  an  equipment  malfunction 

Total  number  of  failures  in  each  failure  mode  for  each  equipment 
malfunction 

Total  number  of  parts  as  related  to  total  number  consumed  in  making 
the  repairs 

Total  number  of  parts  replaced  during  each  equipment  malfunction 

Unit  price  of  parts  or  material  used  inthe  maintenance  action,  except 
pre-expended  bin  material 

Estimated  percent  of  all  failures  reported  during  a given  report  period 

At  any  point  in  the  life  of  material,  the  incremental  change  in  the 
number  of  failures  (change  in  the  measure  of  life) 

T otal  number  of  parts  or  components  in  a given  universe  under  study 

Total  man-hours  required  during  a maintenance  action 

Total  number  of  man-hours  required  to  identify  cause  of  malfunction 
and  determine  corrective  action 


Maintenance  Time  - Active 


Logistics  and  Administration 
Time 


Required  Material 
(Quantity) 

Quantity  (Number  of  Items 
Received  or  Returned) 


The  sum  of  total  maintenance  man-hoursto  diagnose  failure  and  total 
maintenance  man-hours  for  active  repair 

Total  number  of  man-hours  repair  is  delayed  solely  in  waiting  for  a 
replacement  part  and  that  portion  of  downtime  not  included  under  ac- 
tive repair  time 

The  number  of  units  of  parts  or  material  used  to  accomplish  a specific 
maintenance  action 

The  number  of  units  of  parts  or  material  used  to  accomplish  a specific 
maintenance  action 
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TABLE  5-1  (Cont’d) 

DATA  ELEMENT  DEFINITIONS  AND  IDENTIFICATION  OF  SYSTEM  SOURCES  OF 
DATA  APPLICABLE  TO  EACH  DATA  ELEMENT  DESCRIPTOR^ 


Data  Elements  Definition  or  Explanation 


COST  ACCOUNTING  DESCRIPTORS:  (Confd) 


Items  Processed  (Number) 


The  number  of  times  collective  action  was  taken  against  the  item  described 
in  the  work  unit  code  block 


Maintenance  Control  Number/ 
Job  Control  Number/Report 
Serial  Number/Ship  Account 
Number 

Disposition  of  Removed  Item 

Repairman  and  Specialty/ 
Rate  (title) 

Person  Reporting  — Rate 
(title) 


Four-digit  number  assigned  by  the  maintenance-data-control  center 


One  of  8 codes  checked  to  indicate  disposition  of  removed  item 

Name  of  personnel  making  repairs  or  adjustments  to  failed  equip- 
ment and  title  or  technical  rating 

Name  signature  of  personnel  recording  data  on  report 


Figure  5-  7.  Sample  Printout  Tabulating  Environmental  Exposure"^ 
(Reprinted  from  Reliability  Handbook  ivif/rpemtission  of 
McGraw-Hill  Book  Company,  Inc.) 
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A typical  coding  scheme  is  one  developed 
for  the  COFEC  reliability  data  system  (Ref. 
4).  Failure  eauses  and  eorreetive  aetions  are 
eoded.  using  six  digit  positions.  In  this  sys- 
tem reporting  eode,  the  first  two  digits  are 
used  to  identify  the  failure  mode,  the  seeond 
two  digits  speeify  the  eause  of  failure,  and 
the  last  two  digits  indieate  the  eorreetive 
aetion.  Eaeh  eategory  ean  oeeur  in  99  dif- 
ferent ways.  A master  eode  list  is  used 
whieh  defines  eaeh  failure  mode,  eause,  and 
eorreetive  aetion.  This  list  ean  be  expanded 
as  the  projeet  progresses,  so  that  tlie  terms 
need  not  be  defined  in  advanee.  A typieal 
master  eode  list  is  shown  in  Fig.  5-2. 

5-2.2  COMPUTER  PROGRAMS  FOR 
DATA  BANK  ESTABLISHMENT 
AND  UPDATING 

Computer  programs  must  be  written  or 
aequired  whieh  ean  be  used  to  establish  and 
update  the  data  bank.  The  program  details 
depend,  of  eourse,  on  the  computer  on 
whieh  the  system  is  implemented.  Sort 
and  merge  routines  must  be  available  for 
sorting  new  data  into  the  desired  sequence 
and  merging  it  with  the  existing  file  to  pro- 
duce a new  file.  Programs  written  in  a re- 
port generator  language  sucli  as  RPG  permit 
the  structure  of  the  data  base  to  be  altered 
and  information  to  be  added  or  deleted  as 
desired.  Generally,  one  ought  to  use  exist- 
ing programs  as  mueh  as  feasible;  they  ought 
to  be  programs  already  running  on  tlie  eom- 
puter  available  to  you. 

5-2.3  EXTRACTION  ROUTINES  AND 
PROGRAMS 

Programs  must  be  developed  or  aequired 
whieh  output  prescribed  formats  using 
seleeted  parameters  obtained  from  the  data 
bank.  Outputs  to  paper  or  files  can  be 
prepared  by  the  computer  through  the  use 
of  appropriate  extraction  routines  and  the 
information  stored  in  the  data  bank.  The 
information  in  the  data  bank  must  be  out- 


putted in  various  formats  eonvenient  for 
use  by  both  contraetor  and  Army  program 
managers. 

A separate  fixed-format  routine  may  be 
written  for  each  report  format  required. 

When  the  number  of  different  formats  is 
small,  this  procedure  is  economieal.  As  a 
system  design  progresses,  however,  reporting 
requirements  change.  The  varying  reporting 
requirements  and  the  variations  in  the 
number  of  groups  using  different  output 
formats  can  greatly  expand  the  total  number 
of  formats  needed.  Under  these  circum- 
stanees,  the  expense  of  programming  a new 
extraction  routine  for  each  new  output  for- 
mat can  become  excessive. 

To  make  a separate  extraction  routine  un- 
necessary for  generating  each  output  for- 
mat, a variable-format  extraction  program 
can  be  employed.  Such  a program  com- 
pensates for  the  greater  programming  ex- 
pense involved  with  the  ability  to  replace 
a number  of  fixed-format  extraction  routines: 
With  a variable-format  extraction  program, 
personnel  not  trained  in  computer  pro- 
gramming can  write  requests  for  a variety 
of  report  formats  in  some  form  of  a user 
language.  A user  language  can  be  developed 
specifically  for  the  system  in  question  or  a 
commercially  available  system,  such  as 
RPG.  can  be  used.  Variable-format  extrac- 
tion programs  can  use  standard  output 
formats.  However,  the  specific  type  of 
information  listed  in  any  output  is  estab- 
lished by  the  user,  filling  out  a standard  re- 
quest form.  Outputs  thus  may  be  tailored 
easily  to  the  exact  needs  of  the  user. 

5-2.4  PROGRAMMING  EXTRACTION 
ROUTINES 

Two  general  types  of  report  generating 
programs  can  be  developed:  (1)  those  using 
fixed-format  extraction  routines,  and  (2)  the 
automatic  variable-format  extraetion  and 
aeeumulation  program.  Eaeh  of  tliese  two 
programs  will  be  discussed. 
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MASTER  CODE  LIST  for  Transaucers 


prefix T 

01  Physical  Discrepancy 

02  Static  Error  Out  of  Tolerance.  Recelvinc  & Inspection  Test 

03  Erratic  Output 


11  Resistance  Measuretnent  Out  of  Tolerance 


16  Leaking 


02  Static  error  out  of  tolei'ftnce,  receiving  Inspection  tept 

OP  Ol^^Drive  link  ball  out  of  viper  enr.  ball  socket 
02  01[^  VcMor  XYZ  I'Tz*  Co*  hss  enlarged  socket  and  h2s  aaded  potting 
compound  for  strength 


02  03  atEourdon  tube  braze  Joint 

02  03  lOlJ  Vendor  XYZ  Kfg.  Co.  operators  are  trained  at 

Prazing  School  effective  Jan. 32, 63.  serial  no.jcor 
02  03  Ver.'V:>r  XYZ  Co.  now  using  Improved  leak  test' 
Effective  Mor.3#63. 


02  03  (ol)  Vendor  ABCD  KJ£.  Co.  has  revised  brazing  process 
effeettve  serial  no.xxx 

02  03p^  Verxdcr  AECi)  Mfg.  Co*  has  redesigned  brazed  section 
affective  serial  no.  152 


Figure  5-2.  Typical  COFEC  System  Master  Code  List* 

(Reprinted  from  Reliability  Handbook  with  permission  of 
McGraw-Hill  Book  Company,  Inc.) 


The  fixed-format  extraction  routines  of 
the  report  generator  program  constitute  a 
single  computer  program  that  prepares  all 
requested  reports.  Some  combinations  of 
reports  can  be  prepared  simultaneously. 
Other  combinations  require  separate  com- 
puter runs.  The  program  might  work  in  the 
following  manner.  A report  request  is  read 
into  the  computer  to  establish  which  report 
or  combination  of  reports  is  to  be  prepared, 
and  designates  an  output  file  for  each  of  the 


requested  reports.  Information  from  the 
data  bank  tape  might  then  be  stored  in  the 
core.  Next,  extraction  routines  correspond- 
ing to  each  of  the  requested  reports  are 
called,  and  the  parameters  needed  in  each 
report  are  extracted,  tabulated  where  speci- 
fied, placed  in  the  requested  format,  and 
written  on  the  designated  file.  At  the  ap- 
propriate interv  al,  totals  of  the  parameter 
values  which  have  been  accumulated  are 
printed.  When  all  records  from  the  data 
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bank  have  been  processed,  the  individual 
output  fdes  are  transferred  to  a single  fde  to 
facilitate  printing. 

5-2.5  OPERATION  OF  THE  DATA  BANK 

Operation  of  the  data  bank  involves  ( I ) 
its  establishment  and  maintenance,  and  (2) 
its  use  as  a source  of  parameters  for  reports. 
Its  successful  operation  requires  close  co- 
ordination between  engineering  and  data 
processing  personnel.  On  large  programs,  a 
data  coordinator  and  an  engineering  coor- 
dinator for  data  bank  operations  should  be 
appointed  to  the  program  manager’s  staff 
The  details  of  establishing  and  maintaining 
the  data  bank  and  of  extracting  data  from 
it  are  described  in  the  paragraphs  that 
follow  (Ref  7). 

The  operation  of  the  data  bank  requires 
that  the  data  be  initially  entered  and  then 
updated  later.  Coordinated  effort  between 
engineering  and  data  processing  personnel  is 
required.  The  details  of  this  operation  are: 

1 . The  request  that  information  initially 
be  entered  into  the  data  bank  should  be 
made  by  the  program  manager,  to  whom  the 
equipment  engineers  respond  by  submitting 
completed  data  input  forms  certified  by 
their  signatures. 

2.  Revisions  of  data  in  the  data  bank  are 
initiated  by  the  responsible  equipment 
engineer  by  requesting  the  necessary  forms 
from  the  engineering  coordinator,  and  sub- 
mitting the  completed  and  certified  forms 
to  him. 

3.  Completed  data  forms  then  should  be 
reviewed  technically  by  the  program  man- 
ager’s staff.  Tlie  data  coordinator  then  re- 
views the  forms  for  proper  addressing  of 
data,  correct  format,  etc.,  and  forwards  the 
forms  for  data  entry.  The  data  forms  then 
are  returned  to  the  data  coordinator  for 
checking  against  the  revision  report. 


4.  For  the  initiating  operation,  the  EDP 
facility  creates  a new  data  bank  file  from 
all  entries  and  issues  a data  bank  file  listing. 
For  updating,  the  EDP  facility  merges  data 
from  the  new  entries  with  the  old  data 
bank  file  and  creates  a revision  report  list- 
ing all  data  additions,  deletions,  and  revi- 
sions. The  data  bank  file  listing  or  the  re- 
vision report  is  checked  against  the  corres- 
ponding data  forms  by  the  data  coordinator 
and  submitted  to  the  program  manager  for 
review. 

Information  is  extracted  from  the  data 
bank  in  the  following  manner: 

] . The  engineering  coordinator  initiates 
the  request  for  a specific  report  to  the  data 
coordinator. 

2.  The  data  coordinator  forw  ards  a re- 
quest form  to  the  EDP  facility,  indicating 
the  extraction  routines  to  be  used  with  the 
new  data  bank  file,  along  with  any  special 
instructions. 

3.  The  printed  report  then  is  submitted 
to  the  program  manager  by  the  EDP  facility 
via  the  data  eoordinator. 

A feature  of  the  preceding  operation  is 
that  all  communication  with  the  EDP  facility 
is  accomplished  by  the  data  coordinator. 

This  procedure  frees  the  equipment  engineers 
and  the  program  manager  from  all  liaison 
with  the  facility. 

Many  new  er  programs  will  have  online 
timeshared  facilities  that  eliminate  the  need 
for  much  of  the  communication  and  red 
tape  described  in  this  paragraph. 

5-3  RELIABILITY  DATA  SYSTEMS 
OPERATING  PROCEDURES 

The  development  of  a reliability  data  sys- 
tem requires  the  creation  of  procedures,  in- 
struction, and  forms  for  reporting,  handling. 
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and  monitoring  test  data.  It  also  requires 
computer  programs  for  efficiently  processing 
the  data  into  formats  suitable  for  reliability 
analyses. 

Two  important  functions  of  the  system 
operation  will  be  discussed  in  detail  in  this 
paragraph:  (1)  data  reporting,  which  estab- 
lishes the  requirements  and  instructions  to 
be  used  by  test  personnel  in  reporting  data; 
and  (2)  data  control,  which  consists  of 
monitoring  the  reported  data  to  ensure  its 
completeness,  accuracy,  and  validity,  and 
preparing  it  for  computer  input.  Another 
important  function,  reliability-data  reporting, 
will  be  discussed  in  par.  5-4. 

In  order  to  prepare  an  integrated  reliability 
data  system  for  a specific  system,  the  sys- 
tem weapon  specifications  and  technical 
development  plan  must  be  evaluated.  As  a 
result  of  these  analyses,  information  derived 
from  specific  test  data  reporting  require- 
ments, the  subsystem  reliability  model,  and 
computer  report  requirements  can  be  devel- 
oped into  the  specific  data  reporting,  con- 
trol, and  processing  instructions  required  for 
the  system. 

6-3.1  DATA  REPORTING 

Data  reporting  procedures  and  instructions 
must  be  issued  to  the  test  groups  for  re- 
cording the  test  and  failure  data  needed  for 
reliability  measurement  and  other  purposes 
(Refs.  5 and  6).  These  procedures  define 
the  types  of  data  to  be  reported,  the  forms 
to  be  used,  and  the  instructions  for  com- 
pleting them. 

The  data  to  be  reported  for  reliability 
assessment  should  be  defined  in  a standard 
data  reporting  requirements  document.  This 
document  should  be  prepared  as  part  of  the 
contractor's  reliability  test  program. 

A data  reporting  group  should  be  organ- 
ized to  develop  the  forms  for  data  reporting 
and  the  procedures  for  their  use.  The  forms 


that  are  established  should  provide  instruc- 
tions for  the  collection  of  the  data  re- 
quired for  reliability  measurement.  They 
also  may  contain  information  required  for 
purposes  other  than  reliability  measurement. 

The  test  information  needed  for  reliability 
purposes  includes: 

1.  Test  Description 

a.  Test  report  number 

b.  Test  level  - component,  equip- 
ment, or  subsystem 

c.  Test' type -qualification,  acceptance, 
field,  etc. 

d.  Test  site 

e.  Test  environment 

f.  Date  of  test 

g.  Test  condition-operating,  non- 
operating, or  cycling. 

2.  Hardware  Identification : 

a.  Hardware  name 

b.  Hardware  drawing  number 

c.  Hardware  serial  number 

d.  Subhardware  actually  involved  in  test 

e.  Hardware  level 

f.  Vendor. 

3.  Test  Results: 

a.  Time  or  cycles  to  failure 

b.  Component  failing 

c.  Failure  modes. 
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Accurate  recording  of  failure  data  is 
essential  to  any  reliability  data  system. 

Failure  forms  must  be  provided  to  test  and 
operating  personnel.  When  a failure  occurs, 
a failure  report  - which  contains  a des- 
cription of  the  failure,  hardware  identifica- 
tion, test  conditions  at  the  time  of  failure, 
cause  of  failure,  and  hardware  disposition  — 
must  be  written.  If  the  failure  occurred 
during  test,  the  test  document  number  must 
be  referenced  on  the  failure  report.  Other 
items  of  information  are  added  to  this  re- 
port by  the  failure  analysis  system  for  pro- 
cessing purposes.  This  additional  information 
usually  consists  of  failure  classification, 
classification  as  to  relevancy,  fault  isolation 
code  (used  to  identify  the  failed  subcom- 
ponent in  those  components  which  are 
multifunctional),  and  the  simulated  mission 
environment  that  caused  the  failure  to 
occur. 

Problems  often  arise  when  data  must  be 
reported  by  field  maintenance  and  logistic 
personnel  who  often  are  so  busy  at  their 
own  tasks  that  they  do  not  have  the  time 
to  record  data  properly.  It  may  be  neces- 
sary, in  such  a case,  to  assign  reliability 
field  personnel  to  the  task  of  gathering  data 
and  filling  out  forms.  This  may  be  the 
biggest  difficulty  of  all,  in  getting  good  field 
data. 

Different  forms  should  be  developed  for 
in-house  and  field  use.  The  in-house  forms 
should  be  used  to  record  defects  discovered 
during  receiving  inspection  and  acceptance 
testing.  Additional  in-house  forms  must  be 
developed  for  use  during  reliability  demon- 
stration testing.  Field  forms  should  be  de- 
signed which  facilitate  the  easy  reporting  of 
failures  occurring  in  the  field. 

A wide  variety  of  forms  has  been  de- 
veloped. Several  typical  forms  are  presented 
in  Figs.  5-3  to  5-5;  Chapter  9,  Ref  4,  shows 
other  forms.  The  data  forms  should  be  set 
up  so  that  data  entry  can  proceed  directly. 


5-3.2  DATA  CONTROL 

Careful  control  must  be  exercised  over 
the  data  recording  operations  in  order  to 
assure  timely  and  accurate  data  reporting. 
Procedures  must  be  established  for  (1)  col- 
lecting, reproducing,  distributing,  and  filing 
test  and  failure  forms;  (2)  handling  the  re- 
ported data;  (3)  methods  of  monitoring  the 
data  for  compliance  with  requirements;  (4) 
preparing  the  data  for  conversion  into  a 
medium  acceptable  to  data  processing;  and 
(5)  providing  for  corrections  to  the  reported 
data.  See  Fig.  5-6  for  a typical  data  pro- 
cessing system.  Since  the  data  being  col- 
lected are  for  a computerized  data  proces- 
sing system,  processing  instructions  must 
be  developed  and  the  data  must  be  tabu- 
lated in  a format  that  permits  automatic 
error  checking 

The  paragraphs  that  follow'  are  brief 
descriptions  of  the  tasks  involved  for  each 
of  the  preceding  functions  and  responsi- 
bilities. 

5-3.3  DATA  HANDLING 

Test  data  forms  generated  in  the  test 
areas  (at  all  levels  of  test)  should  be  sent 
to  the  data  control  area  for  processing  and 
analysis.  Failure  data  forms  should  be  sent 
to  the  failure  analysis  group  for  review  and 
classification. 

Wlien  blank  foniis  are  sent  to  the  test 
areas,  they  should  contain  whatever  pre- 
printed information  - such  as  hardware 
identification  - is  feasible.  This  will  re- 
duce recording  errors  and  save  time  for  the 
test  personnel.  If  a mechanized  data  pro- 
cessing system  is  being  used,  certain  fields 
of  data  can  be  coded  for  ease  of  processing 
and  minimizing  transcription  errors. 

Procedures  for  data  reporting  should  be 
written  and  standardized.  These  procedures 
should  contain  instructions  as  to  when 
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1.  i*ei»onT  NO.  ^ 0 Q ^ REPqnT  no.  a neportino  activity 

4.  Missile  TMS  B,  Missiue  SEfllAU  NO. 

e,  FAILED  ITEM  PART  NO. 

7.  FAILED  ITEM  9/N 

8.  FAILED  ITEM  NAME 

0.  FAILED  ITEM  MFR. 

10.  F/I  REF.  0E5I0. 

11.  NEXTAS3Y  PART  NO. 

12.  NEXT  ASSY  NAME 

13.  NEXT  ASSY  MFR. 

14.  NEXT  ASSY  REF.  DES. 

15.  SYSTEM  NO. 

22 

, FAILURE  DISCOVERED  DURING  1 

23 

. REASON  FOR  REPORT 

24 

. R'FPAIR  OR  DISPOSITION  ACTION  I 

25, 

REPLACEMENT 

.1 

DENCH  TEST 

.3 

CHECKOUT 

.1 

FAILED  ITEM 

,1 

REPAIRED  1 N PLACE 

3 

CONDEMNED 

.1 

IDENTICAL  PART 

INSPECTION 

.6 

MAINTENANCE 

.a 

T.O.  DIRECT 

.2 

REP  REINSTALLED 

.6 

HELD  FOR  REP. 

.2 

SUBSTITUTE  PART 

YTCRACE 

.7 

MFR.  TEST 

,3 

TIME  EXPIRED 

3 

ADJUSTED 

T 

DEPOT  REP. 

.3 

NONE  NEEDED 

A 

SHIPPING 

.3 

OPERATION 

.4 

OTHER 

.4 

ELIMINATED 

.8 

FAILURE  ANALYSIS 

,4 

NOT  AVAU  ABLE 

20.3  TEST  CONDITION  CODE 

20.4  ENVIRONMENTCODE 

26.5  SYSTEM  AFFECTED 

27.  REPORTED  BY 

1 

Figure  5-3.  Typical  Sample  Failure  Report 
(Reprinted  from  Reliability  Handbook  w/th permfes/on  o f 
McGraw-Hill  Book  Company,  Inc.) 
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(A)  Front  of  Form 

Figure  5-4.  Report  Summary  Format  Stipulated  in  MIL-STD-831^ 


data  will  be  reported,  on  what  form,  what  attend  periodic  training  programs  to  review 

disposition  will  be  made  of  data  sheets,  as  the  reporting  forms  and  to  discuss  the  pro- 
well as  defining  fields  on  the  form  and  per  information  to  be  inserted  into  the 

acceptable  ranges  for  the  data.  various  blocks  on  the  forms. 

Personnel  testing  the  hardware  must  ac-  Proper  training  is  required  for  all  person- 

curately  record  all  of  the  information  re-  nel.  However,  personnel  who  are  responsi- 

quired  on  the  test  forms  and  faithfully  pro-  ble  for  gathering  data  in  the  field  or  in  other 

ceed  through  all  steps  in  the  program.  For  nontest  environments  should  receive  especi- 

this  reason,  a training  program  should  be  ally  careful  training  in  order  to  ensure  that 

established  for  them.  Test  personnel  should  they  properly  record  all  data. 
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(B)  Rear  of  Form 

Figure  5-4.  Report  Summary  Format  Stipulated m MIL  -STD-83 1 ® 


After  all  processing  has  been  completed, 
the  original  data  sheets  should  be  filed  for 
future  reference. 

5-3.4  DATA  MONITORING 

Army  personnel  responsible  for  monitor- 
ing the  collection  of  data  must  have  access 
to  the  test  areas  to  assure  that  the  tests 
are  being  run  properly  and  that  data  are 
being  recorded  accurately  . 


After  report  forms  are  received  by  test 
personnel,  they  must  be  checked  for  gross 
errors  - e.g.,  hardware  identification,  pro- 
per recording  of  test  results,  sign-off  signa- 
tures, and  legibility  . When  such  errors 
occur  in  the  test  or  failure  documents, 
they  must  be  returned  to  the  originator 
for  correction. 

One  method  of  assuring  that  all  test  data 
are  being  collected  and  processed  is  to  use 
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(A}  Page  1 


Figure  5-5.  Hughes  Troubles  Failure  Report* 
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Figure  5-6.  Typical  Data  Processing  System 
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a check  list  containing  the  drawing  numbers 
and  serial  numbers  of  items  scheduled  to 
be  tested,  and  which  can  be  compared 
against  the  data  being  processed.  Cheek 
list  reports  are  returned  to  data  control  if 
data  are  missing. 

5-3.5  PREPARING  TEST  DATA  FOR 
COMPUTER  PROCESSING 

The  information  contained  in  test  and 
failure  documents  must  be  processed  to 
assure  that  the  input  data  records  are  in 
proper  format  for  computer  usage. 

There  are  two  basic  types  of  input  data: 
test  information  and  failure  information. 
These  usually  exist  in  separate  documents. 
This  segregation  of  data  is  carried  through 
input  processing.  The  data  are  submitted 
for  data  processing  in  that  segregated 
fashion. 

The  instructions  for  processing  the  in- 
put data  must  contain  detailed  information 
on: 

1.  The  location  of  data  fields  on  ori- 
ginal test  or  failure  documents 

2.  The  plaeement  of  data  fields  on  the 
input  records 

3.  Special  handling  that  may  be  re- 
quired for  any  particular  data  form  or 
field  of  information. 

After  input  processing  has  been  aeeom- 
plished,  the  input  records  (cards,  tape) 
should  be  forwarded  to  data  processing  for 
entry  into  the  processing  system. 

5-3.6  ERROR  CORRECTION 

When  errors  are  detected  in  the  data 
during  error  checking,  listings  explicitly 
defining  the  errors  should  be  sent  to  the 
data  control  group.  Data  control  person- 


nel then  must  correct  the  errors  and  re- 
turn the  data  sheet  to  the  area  responsible 
for  that  error.  The  corrected  data  are 
prepared  for  processing  and  reinserted  into 
the  processing  cycle. 

5-4  RELIABILITY  REPORTING 

The  contractor’s  reliability  reporting 
group  should  prepare  all  necessary  in-house 
and  eontractual  reports  for  the  reliability 
test  and  measurement  program.  The 
general  contents  and  procedures  for  gen- 
erating these  reports  must  be  developed  in 
aeeordance  with  Military  Specifications  and 
the  particular  contract.  These  procedures 
and  the  report  contents  are  a function  of 
the  specific  subsystem  reliability  reporting 
requirements. 

The  following  reports  should  be  prepared: 

1.  Reliability  Status 

2.  Failure  Summary 

3.  Historic  Test  Result 

4.  Failure  Status 

5.  Hardware  Summary 

6.  Failure  Analysis  Follow-up 

7.  Failure  Rate  Compendium. 

The  reports  deseribed  in  this  paragraph 
ean  be  used  by  the  eontraetor  in-house  as 
well  as  by  the  Army.  The  eontraetor  can 
use  them  for  purposes  sueh  as  estimating 
spares  and  logistie  requirements,  main- 
taining a test  history  by  serial  number  of 
eritieal  and  limited  life  items,  or  for  es- 
tablishing a failure  rate  eompendium  based 
on  actual  test  and  field  experience.  The 
status  reports  produced  by  the  contractor 
for  the  Army  ean  vary  from  project  to  pro- 
ject. 
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The  contents  and  format  of  reliability 
status  reports,  which  must  be  issued 
periodically  throughout  the  program,  should 
be  discussed  by  the  Army  and  the  con- 
tractor to  arrive  at  a mutually  agreeable 
document.  In  many  cases,  reliability  re- 
ports generated  by  the  contractor’s  normal 
procedures  can  be  used  by  the  Army  with- 
out modification. 

5-4.1  RELIABILITY  STATUS  REPORTS 

The  reliability  status  report  presents 
estimates  cf  the  reliability  of  each  compon- 
ent, equipment,  and  subsystem;  pinpoints 
reliability  problem  areas;  and  discusses 
possible  corrective  actions. 

The  reliability  status  report  should  con- 
tain: 

1.  A brief  description  of  the  subsystem 
and  equipment  operation,  and  mission 
against  which  reliability  is  reported 

2.  The  subsystem  block  diagram  and 
reliability  equation,  or  an  equivalent  fault 
tree  or  cause-consequence  chart 

3.  A summary  of  the  sources  of  test 
data 

4.  A table  relating  the  current  measured 
reliability  and  reliability  requirements  for 
each  hardware  level 

5.  Growth  curves  that  tabulate  measured 
reliability  versus  time 

6.  A discussion  of  reliability  problem 
areas,  proposed  corrective  action,  and  the 
results  of  previous  corrective  action 

7.  A tabulation  of  the  failure  rates  and 
reliability  estimates  at  the  component, 
equipment,  and  subsystem  levels  (see  Fig. 
5-7) 

8.  The  s-confidence  levels  at  which  the 


required  reliability  was  demonstrated  by 
each  hardware  element. 

The  composite  reliability  status  report 
in  Fig.  5-8  and  the  reliability  status  re- 
port supplement  in  Fig.  5-9  represent  two 
useful  formats  for  summarizing  reliability 
status.  In  the  fiist  report,  failure  rates, 
reliability  indices,  s-confidence  levels,  and 
mission  information  are  summarized  by 
environmental  test  category  for  each  hard- 
ware item  tested. 


5-4.2  FAI  LURE  SUMMARY  REPORTS 

The  failure  summary  report  presents  a 
complete  record  of  all  failures  occurring  on 
a particular  program.  Making  this  report 
mandatory  helps  to  ensure  that  failures 
are  identified  and  reported  properly,  that 
important  and  repetitive  failures  are  analy- 
zed in  detail,  that  eauses  and  modes  of 
equipment  failures  are  determined,  and 
that  eorreetive  aetions  are  developed. 

Monthly  failure  summary  reports  should 
eontain  the  following  information: 

1 . Hardware  identifieation  - including 
nomenclature,  drawing  number,  serial 
number,  vendors,  and  program  code 

2.  Test  description  - including  test 
type,  environment,  site  or  reporting  activity, 
and  date  of  test 

3.  Test  results  - including  failure  re- 
port number,  failure  classification,  and 
description  of  failure 

4.  Failure  investigation  analysis,  in- 
cluding the  corrective  action  recommended 
or  taken 

5.  Names  of  the  responsible  personnel. 

A sample  failure  summary  report  is  shown 
in  Fig.  5-10. 
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EQUIPMENT  RELIABILITY  STATUS  REPORT 

PROJECT  A3 Cl  ■ 50%  CONFIDENCE  (BESTESTIMATE)  C2  ■ 80%CONnDeNCS  CURRENT  DATE PAGE* 


NOMENCLATURE 

MISSION 

B 

MISSIO! 

c 

NUMBER 

— 

RELL\BILITY 

FAILUR 

RATE 

REU  * 

Ii.irr 

FAILUR 

1 RA-E 

RCLIA 

Jiurrr 

Aci 

Xc2 

Xci 

Xcz 

R ci 

Rc2 

A?ct 

X C2 

Rci 

Rc2 

RECONN-^L^ANCE  VEIIK 

:le  subsystem 

.0433806 

,0755389 

9575 

.9273 

0230083 

,0418060 

,9773 

.9591 

.0827581 

. 1441077 

9205 

.B85C 

TELEMEKTEY  i COMIJA'ND  EQUIPMENT 

TRANSOUTOR 

0194C0543G003 

10038418 

. 0129154 

9962 

. 9872 

0034575 

,0116207 

.9965 

.9834 

. 0081469 

.0206359 

9939 

. 9756 

TRANSOUTOR 

0194C0543G003 

. 003S418 

. 0129154 

9962 

. 9872 

0034576 

,0116207 

,9965 

. 9884 

. 0061469 

.0206359 

9939 

, 9796 

PROGRAMMER 

0194006960001 

. 002S312 

. 0116673 

9952 

. 9884 

0017363 

.0103553 

.9983 

, 9897 

. 0039563 

.0186699 

9961 

. 9816 

AMPLIFIER 

0604D0147G001 

.0033467 

. 0125532 

9967 

. 9875 

0020166 

,0113457 

.9980 

. 9837 

. 0057011 

.0199872 

9943 

.9803 

MULTICODER 

0926D0972G001 

.0000000 

. 0011743 

9999 

. 9988 

0000000 

,0006572 

.9999 

.9993 

. 0000000 

,0207191 

9999 

.9793 

SENSORS 

. 0007143 

9996 

.9993 

0003993 

,0007512 

.9996 

.9992 

, 0083293 

.0175541. 

9917 

. 9826 

BAROS^VITCK 

. 0200054 

9890 

. 9301 

0060607 

.0151016 

,9994 

.9850 

. 0150113 

.0289132 

9851 

. 97U 

TELEMETRY  i COMMAN 

D EQUIPMENT 

GROUPING 

.0252424 

.0615249 

9751 

.9404 

0136711 

.0333214 

.9863 

.9672 

. 0391449 

.0954103 

9617 

.9090 

CONUrfUNICATIONS  EQUII 

^MENT 

BEACON 

0563E0617G001 

.0004861 

.0016290 

9935 

, 9984 

0003579 

.0007145 

.9996 

.9993 

, 0015500 

,0037440 

9984 

.9963 

PULSE  GENERATOR 

0215E0175G001 

. 00343S7 

. 0113545 

9966 

. 9876 

0005678 

,0095312 

.9995 

. 9905 

. 0110345 

,0100534 

9890 

. 981C 

FLASHISC  LIGHT 

0651C0643C003 

.0000000 

. 0007365 

9999 

. 9993 

0000000 

.0004932 

.9999 

.9995 

.0000000 

. 0011223 

9999 

, 998? 

RECEIVER 

0194C0T96P0O1 

.000989S 

. 0013563 

9991 

.9987 

0006563 

.0010976 

.9993 

. 9989 

. 0012123 

.0012013 

9988 

. 9954 

TRASSMITTER 

0926B0979P001 

. 0027573 

. 008S379 

9973 

. 9912 

0051234 

.0065374 

.9950 

. 9935 

. 0102567 

, 0122667 

9890 

,9878 

COMMUNICATIONS  EQUI 

>MENT  GROUPING 

.007668$ 

.0153075 

9923 

.9847 

0067454 

.0135438 

.9933 

.9864 

.0240535 

.048  2961 

9762 

.9528 

VEHICLE  EOUIPMENT 

VEHICLE  COSTROLLER 

0179DOS69C003 

. 0036998 

. 0101933 

9963 

. 9899 

0025001 

.0084567 

, 9975 

. 9915 

. 0101023 

.0189934 

9899 

.981! 

PROPULSION 

02iiE01$8G002 

, 0060709 

.0094637 

9939 

.9905 

0007011 

.0076776 

.9993 

.9923 

.0084567 

. 0136245 

9915 

.9854 

POWER  SUPPLY 

0179D0870P002 

.0006989 

. 0011097 

9993 

.9988 

0003911 

.0010594 

. 9996 

. 9989 

.0010010 

. 0036364 

9990 

. 996.' 

VEHICLE  EQUIPMENT  G 

lOUPING 

.0104696 

.0164005 

.9895 

.9837 

0035923 

, 0056271 

.9964 

.9944 

.0195600 

.0306390 

.9806 

.959! 

PAYI.OAD  EOUIPMENT 

I TV  CAMERA 

0215E0133G001 

. 0000000 

. 0017563 

9999 

. 9983 

mooooo 

.0009911 

.9999 

. 9991 

. 0000000 

. W253M 

9999 

. 997! 

1 

, PAYLOAD  EQUIPMENT  C 

ROOTING 

.0000000 

.0017563 

9999 

.9983 

OOiWOOO 

.0009911 

.9999 

.9991 

.0000000 

.0'025394 

9999 

.9971 

Figure  5-7.  Table  from  a Sample  Reliability  Status  Reporf 


5-4.3  HISTORIC  TEST  RESULT  RE- 
PORTS 


1 . Hardware  Identification 
a.  Name 


A historic  test  result  file,  containing 
records  of  all  reliability  tests,  is  maintained 
in  the  reliability  data  bank.  The  data  in 
this  file  are  used  to  produce  the  historic 
test  result  report,  an  example  of  which  is 
shown  in  Fig.  5-11.  The  report  should  con- 
tain, as  a minimum,  the  following  informa- 
tion : 


b.  Drawing  number 

c.  Contractor  serial  number 

d.  Vendor  serial  number 

e.  Vendor  identification  (Federal 
Handbook  Code) 
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COMPOSITE  RELIABILITY  STATUS  REPORT 


PnO;rCTA3  COMPON'ES’T  level  report  Cl^SOt-CONFIDENCE  (BESTESTIMATE)  C2 « SO^CONTrOENCE  CURRENT  DATE 

DR.\W1NG  NUMBER  0lD4CQ54:iC003  NOMENCLATURE  TRANSOLATOH  TEST  TYPES 


COSDITION  A 

CONDITION  B 

COSDITION 

C 

CONDITION  D 

TOTAL 

QUAL 

ACCEPT 

ENVmON?^EST 

HOURS 

MIHS  N F 

HOURS  MINS  N 

F CYCLES  N 

F 

HOURS  MISS  N F 

U 

F 

U F 

U T 

TEMPERATURE 

429 

46 

53  1 

57  15  S3 

60 

1 

H 1 

39 

VIDRATJON 

20 

04 

52 

11 

39 

LIFE 

635  16  156 

52 

11 

41 

EQUIVALENT  MISSIONS 

NORMALIZING  ALPHA  VALUES 

COSD. 

A 

COSD. 

B COND.  C 

COSD,  D 

COND.  A COND. 

B 

COND.  C 

COSD.  D 

MISSION  A 

TEMPERATURE 

257.86 

68.  7 

1/100 

1/50 

VllSRATrON 

LIFE 

140.333 

211.755 

1/12 

1/180 

MISSION  5 

TEMPERATURE 

236.511 

76.3333 

1/90 

1/45 

VIURATION 

LIFE 

336.8 

254.  106 

1/05 

1/80 

MISSION  C 

TEMPERATURE 

161.162 

42.9375 

1/1$0 
1/40  . 

1/00 

VIHRATION 

LIFE 

42,  1 

159.816 

1/240 

FAILURE  RATES 
Cl  C2 

RELIABILITY 

Cl 

INDICES 

C2 

nC 

n 

\C 

MIS3I0K  A 

TEMPERATURE 

.0038418  .0129184 

.9962 

.0872 

.014856 

1.0 

.000014898 

VIBRATION 

.0000000  .0117112 

.9900 

. 9883 

. 007126 

1.0 

. 0 

LIFE 

.0000000  .0077623 

. 9999 

. 9022 

. 004723 

1.0 

.0 

MISSION  TOTAL 

.0038418  .0129134 

.9062 

.9872 

. 026405 

3.0 

. 000014898 

^^ssIO^  B 

TEMPERATURE 

.003457S  .011G207 

.9965 

. 9884 

. 013100 

1.0 

. 000012068 

VIBRATION 

.0000000  .004j}798 

. 9999 

. 9931 

. 002969 

1.0 

. 0 

LIFE 

.0000000  .0064677 

.9999 

. 9935 

. 003935 

1.0 

.0 

MISSION  TOTAL 

.0034576  .01  16207 

. 9965 

.9884 

.020004 

3.0 

. 000012068 

MISSION  C 

TEMPERATURE 

.0061469  ,0206359 

.9939 

.9796 

. 023289 

1.0 

.000038140 

VIBRATION 

.0000000  .0390343 

. 9999 

. 9617 

. 023730 

1.0 

.0 

LIFE 

.0000000  0103482 

.9999 

, 9897 

.00G296 

1.0 

. 0 

MISSION  TOTAL 

. 0061459  .0205359 

.9939 

, 9796 

. 053335 

3.0 

. 000038140 

PROJECT  RESULTS 

Cl 

C2 

Cl 

C2 

REQUIRED 

RELIABILITY 

DEMONSTRATED 

CONFIDEKCE 

0134463 

. 0284202 

.9866 

.9719 

. 9899 

.32 

LEGEND:  n IS  NUMBER  OFTER  MS  IN  C CALCULATION 


PAGE  f 

FIELD 

u r 

13 


Figure  5-8,  Sample  Composite  Reliability  Status  Report 
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EQUIPMENT  RELIABILITY  STATUS  REPORT  SUPPLEMENT 

PROJECTA3  U -fMTS  TESTE3  F - OF  FAILURES  Cl  - SOJCONFOENTFraEST  ESTIMATE)  C2 -80%CONFIDESXE  'CURRENT  DATE 


NOVE.NCLATURE 

DRAWING 

NUWnER 

ENVIRONMENT 

TEST 

CLASSJFICATION 

rAtUV*C  RATE 

Reu!A9iuiTr 

QI.V 

U 

tL 

ACC) 

'T 

7]Zl 

D 

X Cl 

X C2 

R Cl 

F 

F 

t: 

F 

RECONNAISSANCE  VTIHTC 

.E  SUBSYSTEM 

TELEMETR\  - COM>US- 

EOUIPMENT 

TRA^^SOLATOR 

0194COS<43G003 

MISSrON  A 

TEMPERATURE 

11 

1 

39 

0033418 

,01»I54 

.9962 

.9872 

\7CR.«8r.OS 

li 

39 

ooonooo 

.0117112 

. 9999 

.9583 

LITE 

11 

41 

13 

0000000 

. 0077023 

. 0999 

.9922 

MISSION  D 

tkmperature 

11 

1 

39 

0034576 

. 0116207 

. 9905 

.9384 

vina.\TiON 

11 

39 

OOOOOOO 

.004^794 

. 9999 

.9051 

LIFE 

11 

41 

13 

0000000 

,00f4i;77 

,9993 

.9035 

MISSION  C 

TEMPERATURE 

11 

1 

39 

C051<C9 

.02093'59|’  .9039 

.9796 

V'lnJtMION 

11 

39 

OOOOOOO 

.03033'.3 

.9099 

.OS  17 

UFE 

11 

41 

13 

ooccooo 

. 0:034{»2 

.9999 

1.9997 

PROGRAMMER 

0194C0<9^001 

MISSION  A 

TE.V,:>En.\TURE 

6 

40 

ocooooo 

,9987 

VIBRATION 

6 

40 

1 

002^315 

.9984 

LIFE 

6 

39 

10 

0000000 

.9835 

MISSION  B 

TEM’' £l  SUTURE 

6 

40 

0000000 

.9921 

xnPR-ATION 

e 

40 

1 

5017369 

,9997 

LI  FE 

6 

39 

0030000 

.9315 

MISSION  C 

TEMPER.ATURE 

6 

40 

OCOOOOO 

.9951 

VIDPJVTION 

6 

40 

1 

0C393C3 

. 9915 

LIFE 

6 

39 

10 

0000030 

.9908 

AMPLIFIER 

0604O0147G001 

MISSION  A 

Tt.MPF.RATURE 

6 

39 

OOOAOOC 

.9917 

VTBFUTION 

G 

39 

0009000 

. 9899 

LIFE 

6 

39 

1 

12 

0033467 

,9675 

MISSION  B 

TEMPERATURE 

6 

39 

0000000 

.0095578 

.9999 

.9905 

VTBIUTION 

6 

39 

0000000 

.0289122 

. 0099 

.9715 

LIFE 

6 

39 

1 

12 

0020199 

.9887 

MISSIG&LC 

TBMT  KIUTURE 

9 

39 

0000000 

.9888 

VIUIUTION 

6 

39 

0000000 

. OHIO 

LIFE 

9 

39 

1 

12 

005701 1 

.9503 

Figure  5-9.  Sample  Reliability  Status  Report  Supplement 


f.  Project  code 

g.  Hardware  level. 
2.  Test  Description: 

a.  Hardware  level 

b.  Test  type 

c.  Environment 

d.  Site 


e.  Date  of  test 

f.  Test  report  number. 

3.  Test  Results: 

a.  Test  time 

b.  Test  cycles 

c.  Test  failures 

d.  Failure  report  numbers 
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FAILURE  SUMMARY  REPORT 

n. 

DRAWING  NUMBER 

103  C 4277  GE 

MANUFACTURER 

0461S 

o.c. 

ENGINEER  E.  BulH 

EQUIPMENT  NAME 

VHF  Transmitter 

FAIL 

RE 

RPTG 

SERIAL 

TE 

T 

FAILURE 

FAILURE  INVESTICATIO.n/aNALVSIS 

CORRECTIVE  ACTION 

RPT.  NO. 

DATE 

kCTVTY 

ND. 

TYPE 

:nvironment 

DESCRIPTION 

CL/\SS 

REQ 

CONCLUSION 

reccmmended/taken 

39138 

10/7/C 

PWla. 

1 

Qual. 

Humidity 

Frequency  out  of  spec.;  moisture  entcrw 
transmitter  due  to  faulty  test  assembly 

30000 

Yes 

Human  error,  assembly  screws  not 
properly  tightened  a^ain.st  component 
itself,  when  not  attached  to  base  plate. 
(F.  A.  R.  A-678) 

R; 

T 

Issue  AN  an<J  SI  to  eliminate  the 
posribilily  c£  recurrence. 

AN  6SS  K 585--')  and 
TR  8017-2  to  SI  21834 

39138 

10/7/6 

Phlla. 

2 

Qunl. 

Humidity 

Frequency  out  cf  spec. : moisture  cnterct 
transmitter  due  to  faulty  test  assembly 

30000 

Yes 

Human  error,  assembly  screws  not 
property  tigSlcneii  against  component 
Itself,  when  not  attached  to  base  plate. 
(F.  A.  R.  A-678) 

R 

T: 

Issue  AN  and  SI  to  eliminate  the 
possibility  of  recurrence 
AN  C8S  E 585-5  and 
TR  B047-2  to  SI  24834 

20  .November  1961 

352-70 

3/H/6: 

AMR 

5476204 

Pre-launch 

Ambient 

Emitting  sidebands  t noise  equal  In  am- 
plitude to  main  carrier.  Signal  strength 
very  low 

33030 

Yes 

tmproper  Tuning  due  to  lack  c£  adequate 
tuning  procedure. 

(F  A.  R.  A-772) 

R: 

T: 

Develop  buning  procedure  and 
Instruct  f>cr.'3onnel  in  use 
TTocetluros  demonstrated  and 
distributed  to  field  personnel. 

352-11 

\2/2^] 

AMR 

5476043 

Hangar 

Ambient 

Low  Power  output. 

20  March  1962 

01000 

Yes 

Discrepancy  between  System  and 
Component  requirements. 

(F.A.R.  A-772) 

K- 

T: 

Change  syr.lcm  spec,  to  conform 
to  component  requlremcnL'i , 
Unable  U>  secure  permission  lo 
chnn;^.'  sf»jc,  to  9 watt  minimum. 
Part  selection  still  done  for 
10  watt  minimum. 

31176 

6/7/62 

Phlla. 

N/A 

Syst.  0/A 

Ambient 

Low  power  output. 

31000 

NO 

Cable  to  power  amplifier  too  long. 

TO  June  1362. 

4S095 

5/31/6; 

Phlla. 

Lot  11-1 

Comp.  0/A 

■>ost  Vibration 

Power  drops  Intermittently. 

02020 

No 

Defective  insulator  on  Q4  heat  sink. 

T 

Replaced  Insulator. 

20  Augu.st  1962 

86720 

S/22/6: 

Phlla. 

Lot  9-2 

Comp.  0/A 

Vibration 

Chassis  shorted  to  case 

01000 

N 0 

Insulation  shorted. 

T; 

Removed  from  case  and  replaced 
sberted  Insulator. 

AC-2257 

8/24/61 

AMR 

5476572 

Pro-launch 

Ambient 

Multiple  oscillation  above  9.5  watts 

01000 

NO 

20  September  1962 

02433 

1/9/63 

Phll.i. 

A30 

Comp.  0/ A 

Vibration 

Unit  broke  tnto  oscillation,  power  output 
and  input  current  dropped. 

01000 

No 

Defective  diode,  CR6 . 

T 

Replaced 

02436 

1/9/63 

Phlla. 

A27 

Comp.  0/A 

Vibration 

No  output-  no  oscillations  from 
oscillator. 

20  March  1963 

01000 

No 

Defective  transistors  Ql»  7,  8.  9. 

T 

Translators  replaced. 

Figure  5-  70.  Sample  Failure  Summary  Report 
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PROJrCT  A3 


mSTOniC  TEST  RESULTS  FILE 


CURRENT  DATE 


PACE# 


NAME  TfUNSOLATOR 


H^ME  TRASSOUTOR 


NAME  TRANSOUTOR 


NAMS  PROGRAMMER 


NAKX  PROORAMMTB 


SAKE  PROGRAMMER 


REC 

LEV 


TEST  DESCRIPTION 


Vn  | MCJ  |dv 


DWG.  SO.  019^CU543C003 


TEST  C0NT>1T1C>NS 


URS  MNlKlHRS  M.V  F CYCLES  Fl  HRS  MS  F, 


COST.  SER. 


c 

OA 

TM 

DP 

63 

12 

01 

C 

3 

30 

, 

20 

c 

OA 

VB 

OP 

63 

12 

01 

C 

43 

c 

OA 

ZA 

DP 

12 

02 

C 

12 

10 

c 

OA 

2D 

DV^ 

63 

12 

01 

C 

1 

c 

a\ 

2C 

DD 

63 

12 

02 

C 

30 

DWG.  NO.  0194C05430003 

COKT. 

SER.  ll‘522776T 

VESDOR  SER.  1122 

VESDOR  CODE  040 15 

c 

OA 

TM 

DP 

63 

12 

02 

C 

8 

30 

1 

20 

DP1202 

8432 

120563 

c 

OA 

vn 

DP 

S3 

12 

02 

c 

48 

DPI  202 

8432 

1205S3 

c 

OA 

ZA 

DP 

63 

12 

02 

C 

12 

DPI  202 

8132 

120563 

c 

04 

ZB 

DP 

63 

12 

02 

C 

1 

05 

DP1202 

8432 

120563 

c 

OA 

zc 

DP 

63 

12 

03 

C 

30 

OP1202 

8432 

120563 

DWG.  SO 

0I94CO543G003 

COST 

SER.  15227769 

VESDOR  SER.  C123 

VENDOR  CODE 04615 

c 

QU 

TM 

DQ 

63 

12 

05 

c 

45  I 

DQOOT4  39339 

0 

1 

8432 

12!263 

c 

QU 

TM 

DQ 

63 

12 

05 

c 

16 

40  1 

10 

39344 

2 

0 

8432 

121263 

DQ0974  39339 

c 

QU 

TM 

OQ 

63 

12 

10 

c 

16 

30 

2 

30 

8432 

122003 

DQ0975 

c 

QU 

vn 

IXJ 

63 

12 

OG 

c 

33 

IX>0y75 

8432 

121263 

DQ0974 

c 

QU 

ZA 

DQ 

63 

12 

01 

c 

22 

15 

1X^0075 

8432 

121263 

CXi09?4 

c 

QU 

2A 

DQ 

63 

12 

09 

c 

22 

IS 

IXA'i»88 

8432 

122003 

OQ0075 

c 

QU 

ZB 

DQ 

63 

12 

06 

c 

1 

30 

CX0O97S 

8432 

121263 

DQ0074 

c 

QU 

2B 

DQ 

(13 

12 

11 

c 

1 

30 

DQ0988 

8432 

1220C3 

DQ0976 

c 

QU 

ZC 

DQ 

63 

12 

06 

c 

45 

(XQO'JtS 

8432 

121263 

DQ0974 

DWO.  SO 

019<5C0696GOOI 

COST. 

SER.  »S221S33 

VENDOR  SER  » 2104 

— LENDOR  CODE045U 

C' 

XK 

TM 

DP 

63 

01 

27 

c 

2 

45 

DPI  092 

8432 

02f363 

3A 

VB 

DP 

63 

01 

2i 

c 

50 

DPJ092 

8432 

020963 

3A 

ZA 

DP 

63 

01 

27 

c 

12 

DM002 

8432 

020803 

DA 

2B 

DP 

63 

01 

27 

c 

6 

DM0a2 

8432 

020863 

c 

DA 

ZC 

DP 

63 

01 

23 

c 

3 

DP1O02 

8232 

020863 

D'AC,  SO 

0l94C0C?eC0Ol 

CONT 

SER.  ,5227834 

VE.SDOR  SER  42105 

VEKDOR  CODE04515 

DA 

TM 

DP 

63 

02 

01 

c 

2 

45 

l>riOD3 

8432 

020363 

DA 

VB 

DP 

63 

03 

02 

c 

10  1 

D)*1C03  39108 

1 

8432 

020363 

DA 

VB 

DP 

63 

02 

03 

c 

50 

DP1094 

8432 

020963 

Dn093 

DA 

ZA 

DP 

63 

02 

01 

c 

12 

OPIOOO 

8432 

0208G3 

DA 

ZB 

DP 

63 

02 

02 

c 

6 

DPiooa 

8432 

020863 

DA 

ZB 

DP 

63 

02 

03 

c 

6 

DP1094 

8432 

020663 

DP2093 

DA 

ZC 

DP 

63 

02 

03 

c 

9 

DP1094 

8432 

020863 

DPI093 

DWG  SO 

0l94C0e9CC001 

CONT. 

SE31.  t522?S35 

VESDOR  SER.  #2106 

VENDOR  CODE  04615 

r' 

OA 

TM 

OP 

63 

02 

03 

c 

2 

45 

DP109S 

8432 

021563 

- 

OA 

VB 

DP 

63 

02 

03 

c 

50 

DP109S 

8432 

021563 

TEST 
DOC  NO. 


FAIL 
DOC  SO. 


FLR 

CLS 


ELM 

CLS 


SHOP 

ORDR 


ENTRY 

DATE 


REFERESCED 


TEST 
DOC  NO. 


FAIL 
DOC  NO. 


VEKDOn  CODE 04615 


NOTE:  CODED  INFORMATION  B DEFCS'ED  IN  TABLE  4' 1, 
LEGEND:  HRS  » HOURS;  MN  • MINUTES;  F ■ NO.  OF  FAILURES 


Figure  5-11.  Sample  Historic  Jest  Results  File’ 


AMCP  706-198 


AMCP  706-198 


e.  Failure  classification 

f Fault  isolation  code  (identifies  hard- 
ware levels  to  which  each  failure  can  be  at- 
tributed) 

g.  Timer  number  (identifies  the  time 
meter  from  which  data  were  obtained). 

4.  Reference  Information: 

a.  Date  of  entry  (date  information 
reaches  file) 

b.  Test  report  number  (references  the 
test  from  which  the  record  was  generated) 

c.  Failure  report  number  (references 
a higher  level  failure  report) 

d.  Project  codes  (identifies  data  used 
from  other  programs). 

The  historic  test  result  file  permits  a 
wide  variety  of  reports  to  be  prepared.  For 
example,  by  using  a control  on  date  of  test, 
reports  containing  data  generated  over  any 
desired  range  of  dates  can  be  prepared.  Use 
of  a control  on  level  of  test  permits  re- 
ports containing  only  subsystem  data  or 
any  desired  combination  of  subsystem, 
equipment,  or  component  data  to  be  pre- 
pared. Use  of  a control  on  test  type  per- 
mits reports  to  be  generated  which  elimin- 
ate engineering  development  and  acceptance 
screening  tests  or  which  use  only  field  data. 
A properly  structured  historic  test  result 
file  permits  reporting  and  analysis  of  any 
desired  combination  of  the  stored  data. 

5-4.4  FAILURE  STATUS  REPORTS 

The  purpose  of  the  failure  status  report 
is  to  maintain  an  historical  record  of  all 
failures.  The  report  contains  an  entry  for 
each  failure.  The  equipment  identification 
and  test  description  from  the  historical 
file  should  be  provided  in  this  report  along 
with  those  portions  of  the  test  results  and 


referenced  information  that  relate  to  fail- 
ures (i.e.,  failure  report  number,  failure 
classification,  include-exclude  criteria,  fault 
isolation  code,  and  referenced  failure  re- 
port numbers). 

The  failure  status  reports  form  the  basis 
of  the  failure  summary.  A description  of 
the  failure,  conclusions  based  on  the  analy- 
ses, and  the  corrective  action  recommended 
or  taken  should  be  added  to  the  status  re- 
port to  form  the  summary.  A sample  sheet 
from  a failure  status  report  is  shown  in 
Fig.  5-12. 

5-4.5  HARDWARE  SUMMARIES 

The  hardware  summary  report  should  con- 
tain an  entry  for  each  hardware  tested,  con- 
sisting of  the  total  test  time  and  failures 
accumulated.  This  report  can  be  used  in 
logistical  planning. 

The  hardware  summary  report  can  be 
expanded  to  include  failure  rates  of  items 
required  for  early  spares  provisioning  esti- 
mates, if  these  items  are  not  included  in 
the  reliability  measurement  plan. 

5-4.6  FAILURE  ANALYSIS  FOLLOW- 
UP REPORTS 

A failure  analysis  follow-up  report 
should  be  issued  periodically  for  internal 
action.  This  report  should  list  every  item 
which  requires  further  action  and  its  status. 

5-4.7  FAILURE  RATE  COMPENDIA 

Perhaps  the  most  valuable  byproduct  of 
the  reliability  test  program  is  the  failure 
rate  compendium  which  is  a compilation  and 
summary  of  the  hardware  test  results  con- 
tained on  the  historic  test  result  file.  The 
data  from  all  projects  should  be  summarized 
by  hardware  groupings  to  provide  a refer- 
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ence  document  for  failure  rates  and  failure 
frequency  analysis.  The  failure  rates  are 
based  upon  actual  test  experience  and  can 
be  used  in  making  predictions  for  new  sys- 
tems, as  well  as  for  making  design  and 
management  decisions. 

The  failure  rate  compendium  also  can  be 
used  to  prepare  failure  frequency  summaries. 
Failures  are  caused  by  design,  manufacturing, 
test,  handling,  or  other  factors.  Properly 
organized  failure  rate  compendia  can  pro- 
vide considerable  insight  into  the  causes  of 
failures. 

5-5  TYPICAL  OPERATIONAL  DATA 
BANKS 

There  are  four  general  classes  of  reli- 
ability data  centers: 

1.  The  Data  Bank/Query  System.  This 
system  uses  a highly  structured  file  to 
handle  logical  queries,  or  perform  specific 
analysis  on  simple  or  composite  sequences 
of  the  data  contained  in  its  memory. 

2.  The  Indexing  System.  This  system 
provides  the  user  with  an  index  (or  catalogs) 
of  nonanalyzed  reports  containing  reliability 
and  related  information.  The  user  must 
perform  his  own  analyses  and  correlations. 

3.  Structured-input  Fixed-query  Sys- 
tem. This  system  allows  large  quantities 

of  raw  data  to  be  obtained,  in  standard  for- 
mats, from  standard  procedures.  Because 
of  the  controlled  data  collection,  a machine 
usable  structure  and  predetermined  analy- 
sis are  performed  to  produce  a series  of 


periodic  statistical  summaries.  Though  the 
system  has  the  ability  to  respond  to  a large 
variety  of  queries,  formatting  and  pro- 
gramming requirements  often  demand  that 
approval  be  received  for  nonstandard  quer- 
ies. 

4.  Analyzed  Summaries.  This  system 
condenses  and  analyzes  input  information 
to  a predetermined  extent,  and  subsequently 
presents  it  in  periodically  updated  summar- 
ies. 

The  reports  on  GIDEP  (Part  Two, 
Appendix  B)  show  many  methods  of  using 
the  data  banks  in  that  system. 

5-6  WARNING 

This  chapter  has  elaborated  on  a com- 
lex,  comprehensive  system  of  reports.  The 
reader  ought  to  remember  two  things: 

1.  The  state  of  the  art  in  computers  is 
changing  so  rapidly  that  minicomputers  now 
can  do  what  the  best  computers  were  able 
to  do  a decade  ago.  Nothing  in  this  chapter 
should  be  viewed  as  a restriction  on  methods 
of  operation.  One’s  own  computer  de- 
partment is  probably  the  best  source  of 
current  information  on  both  hardware  and 
software. 

2.  The  list  of  “musts”  and  “shoulds”  is 
long  enough  so  that  no  program  will  ever  do 
them  all.  The  important  idea  is  to  have  a 
system  for  keeping  track  of  details  and  to 
use  all  the  information  available  to  you  to 
improve  the  product  before  it  gets  to  the 
field.  That’s  what  reliability  measurement  is 
all  about. 
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CHAPTER  6 

ENVIRONMENTAL  TESTING 


6-1  INTRODUCTION 

In  environmental  testing,  an  equipment  is 
tested  under  various  environmental  conditions 
of  temperature,  vibration,  radiation,  humidity, 
etc.,  in  order  to  determine  or  verify  its  capa- 
bility to  operate  satisfactorily  when  sub- 
jected to  stress.  Strength,  life,  and  perfor- 
mance tests,  as  well  as  other  basic  test  types, 
may  all  involve  environmental  testing.  In 
some  hardware  development  programs,  a 
particular  phase  of  the  testing  program 
formally  is  designated  as  environmental 
testing. 

The  effect  of  environmental  conditions, 
whether  man-made  or  nqt,  on  equipment  is 
an  important  consideration  in  reliable  design. 
Environmental  testing  is  performed  because 
of  the  uncertainty  of  the  effects  of  the  en- 
vironment. The  uncertainty  of  the  environ- 
ment can  only  be  accounted  for  by  conser- 
vative design  practices  and/or  by  adequate 
field  testing. 

In  some  environmental  testing,  there  is  a 
deliberate  attempt  to  simulate  as  closely  as 
possible  the  environmental  profile  expected 
during  equipment  operation.  This  is  occa- 
sionally done,  for  example,  in  reliability  dem- 
onstration with  samples  of  prototype  hard- 
ware. Usually,  certain  critical  features  of  the 
total  operational  environment  are  simulated 
at  specific  severity  levels  in  order  to  uncover 
design  and  material  weaknesses  and  workman- 
ship errors.  In  still  other  cases  (such  as  de- 
velopment tests),  the  operational  environment 
may  not  be  known  and  test  conditions  con- 
sequently cover  a wide  range. 


All  environmental  tests  have  the  common 
objectives  of  determining  the  effect  of  the 
environmental  conditions  on  an  item  or 
verifying  that  the  item  is  capable  of  with- 
standing them.  These  tests  are  now  employed 
in  essentially  all  phases  of  hardware  pro- 
grams from  the  parts  and  materials  level  to 
large  systems.  In  programs  relying  primarily 
on  a “build  and  test”  approach,  they  pro- 
vide assurance  in  operational  hardware. 

An  alternative  to  environmental  testing  is 
testing  under  field  conditions.  This  alterna- 
tive can  provide  the  desired  assurance,  but 
usually  costs  more  (especially  in  the  case  of 
complex,  expensive  items)  and  often  delays 
the  desired  information.  In  field  testing, 
test  conditions  generally  are  not  as  well  con- 
trolled as  in  environmental  testing,  so  that 
cause  and  effect  relationships  may  be  ob- 
scured. 

Environmental  testing  ranges  in  sophis- 
tication from  very  crude  methods,  such  as 
using  an  improvised  temperature  chamber,  to 
testing  in  very  elaborate  facilities  permitting 
many  combinations  of  conditions  to  be  sim- 
ulated. Tests  may  be  purposely  destructive 
(as  in  strength  and  life  testing),  or  nonde- 
structive (such  as  proof  tests  and  burn-in). 

The  appropriate  test  conditions  must  be 
carefully  selected.  Basic  factors  to  consider 
are: 

1.  The  possible  environmental  conditions 
during  intended  use  of  the  equipment 
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2.  The  subset  of  these  that  must  be  used 
in  testing 

3.  The  capability  for  generating  and  con- 
trolling them. 

The  environmental  factors  that  can  affect 
the  behavior  of  the  item  during  field  oper- 
ations must  be  determined.  These  factors 
must  be  simulated  to  the  extent  feasible 
within  the  constraints  of  cost,  schedule,  and 
testing  capability.  Not  all  environmental  con- 
ditions that  affect  behavior  can  be  readily 
simulated,  and  very  rarely  can  all  be  gener- 
ated simultaneously  to  account  for  inter- 
action effects.  Trade-offs  therefore  must  be 
made  when  selecting  the  test  condition. 

Ref  5 is  the  definitive  AMC  treatise  on 
the  environment.  This  chapter  is  a brief 
summary  of  a few  of  the  more  important 
points. 

6-2  ENVIRONMENTAL  FACTORS  AND 
THEIR  EFFECTS 


TABLE  6-1 

TYPICAL  ENVIRONMENTAL  FACTORS' 


Acceleration 

Meteoroids 

Acoustics 

Moisture 

Aerodynamic  heating 

Nuclear  radiation 

Albedo 

Pollution,  air 

Asteroids 

Pressure,  air 

Clouds 

Rain 

Cosmic  radiation 

R F interference 

Dew 

Salt  spray 

Electric  atmosphere 

Sand  and  dust 

Explosive  atmosphere 

Shock,  mechanical 

Fog 

Sleet 

Frost 

Snow 

Fungi 

Solar  radiation 

Gases,  dissociated 

Temperature 

Gases,  ionized 

Thermal  shock 

Geomagnetism 

Turbulence 

Gravity 

Vacuum 

Hail 

Vapor  trails 

Humidity 

Vibration 

Ice 

Winds  and  gusts 

Insects 

Wind  shear 

Magnetic  fields 

Zero  gravity 

Environmental  conditions  may  be,  for 
example,  weather  and  solar  radiation,  or 
mechanical  shock  during  transportation  and 
handling,  air  conditioned  rooms  for  com- 
puters, and  radio  frequency  interference. 
Table  6-1  lists  some  environmental  factors 
for  a typical  system. 

The  set  of  environmental  conditions  that 
an  item  encounters  during  its  lifetime  is  its 
environmental  profile.  Therefore,  environ- 
mental testing  must  consider  all  the  environ- 
ments encountered  in  manufacturing,  stor- 
age, transportation,  and  handling,  as  well  as 
those  experienced  during  operational  use. 

The  environmental  conditions  are  not 
always  known  in  explicit  form.  No  one 
knows  precisely,  for  example,  the  environ- 
mental profile  that  a field  artillery  rocket 
will  experience  throughout  its  life  including 
all  types  of  environmental  factors  and  their 


severity  levels.  It  is  possible  to  select  repre- 
sentative characteristics,  such  as  averages  or 
maximum  levels,  of  major  factors  which 
adequately  describe  conditions  for  a test. 

Environmental  conditions  of  greatest 
interest  from  the  reliability  viewpoint  are 
those  that  have  detrimental  effects  on  equip- 
ment operation.  Table  6-2  lists  typical  det- 
rimental effects  of  environmental  factors. 

In  many  cases,  effects  not  detectable  when 
the  factors  are  encountered  singly  appear 
when  two  or  more  are  present  simultaneous- 
ly. For  example,  some  electronic  compo- 
nents function  properly  in  either  a low  tem- 
perature or  a vibrational  environment,  but 
when  the  environments  are  combined,  com- 
ponent leads  break.  Some  possible  com- 
bined effects  of  several  environmental 
factors  are  illustrated  in  Table  6-3.  Com- 
bined environments  do  not  always  have 
adverse  effects.  For  example,  low  temper- 
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Environment 

Winds,  gust  and  turbulence 


Precipitation:  sleet,  snow, 
rain,  hail,  dew,  frost 


Sand  and  dust 


Salt  atmosphere  and  spray 


Humidity 


Sunshine 


High  temperature 


Low  temperature 


Thermal  shock 


High  pressure 


TABLE  6-2 

ENVIRONMENTS  AND  TYPICAL  EFFECTS' 

Effects 

Applies  overloads  to  structures  causing  weakening  or  collapse;  interferes 
with  function  such  as  aircraft  control;  convectively  cools  surfaces  and 
componentsat  low  velocities  and  generates  heat  through  friction  at 
high  velocities;  delivers  and  deposits  foreign  materials  that  interferewith 
functions. 

Applies  overloads  to  structures  causing  weakening  or  collapse;  removes  heat 
from  structures  and  items;  aids  corrosion;  causes  electrical  failures;  causes 
surface  deterioration;  and  damages  protective  coating. 

Finely  finished  surfaces  are  scratched  and  abraded;  friction  between  surfaces 
may  be  increased;  lubricants  can  be  contaminated;  clogging  of  orfices, 
etc.;  materials  may  be  worn,  cracked,  or  chipped. 

Salt  combined  with  water  is  a good  conductor  which  can  lower  insulation 
resistance;  causes  galvanic  corrosion  of  metals;  chemical  corrosion  of 
metals  is  accelerated. 

Penetrates  porous  substances  and  causes  leakage  paths  between  electrical 
conductors;  causes  oxidation  that  leads  to  corrosion;  moisture  causes 
swelling  in  materials  such  as  gaskets;  excessive  loss  of  humidity  causes 
embrittlement  and  granulation. 

Causes  colors  to  fade;  affects  elasticity  of  certain  rubber  compounds  and 
plastics;  increases  temperatures  within  enclosures;  can  cause  thermal 
aging;  can  cause  ozone  formation. 

Parameters  of  resistance,  inductance,  capacitance,  power  factor,  dielectric 
constant,  etc.,  will  vary;  insulation  may  soften;  moving  parts  may  jam 
due  to  expansion;  finishes  may  blister;  devices  suffer  thermal  aging; 
oxidation  and  other  chemical  reactions  are  accelerated;  viscosity  re- 
duction and  evaporation  of  lubricants  are  problems;  structural  over- 
loads may  occur  due  to  physical  expansions. 

Plastics  and  rubber  lose  flexibility  and  become  brittle;  electrical  constants 
vary;  ice  formation  occurswhen  moisture  is  present;  lubricants  gel  and 
increase  viscosity;  high  heat  losses;  finishes  may  crack;  structures  may 
be  overloaded  due  to  physical  contraction. 

Materials  may  be  overstressed  instantaneously  causing  cracks  and  mechanical 
failure;  electrical  properties  may  be  altered  permanently. 

Structures  such  as  containers,  tanks,  etc.  may  be  overstressed  and  fractured; 
seals  may  leak;  mechanical  functions  may  be  impaired. 
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Environment 

Low  pressure 
(High  altitude) 

Gases 

Acceleration 

Vibration 

Shock 

Nuclear/cosmic  radiation 

Thermal  radiation 

RFI 

Solar  radiation 
Albedo  radiation 

Zero  gravity 


TABLE  6-2  (Confd) 

ENVIRONMENTS  AND  TYPICAL  EFFECTS' 

Effects 

Structures  such  as  containers,  tanks,  etc.  are  overstressed  and  can  be  ex- 
ploded or  fractured;  seals  may  leak;  air  bubbles  in  materials  may  ex- 
plode causing  damage;  internal  heating  may  inaease  due  to  lack  of 
cooling  medium;  insulations  may  suffer  arcing  and  breakdown,  ozone 
may  be  formed;  outgassing  is  more  likely. 

Corrosion  of  metals  may  be  accelerated;  dielectric  strength  may  be  reduced; 
an  explosive  environment  can  be  created;  heat  transfer  properties  may  be 
altered;  oxidation  may  be  accelerated. 

Mechanical  overloading  of  structures;  items  may  be  deformed  or  displaced; 
mechanical  functions  may  be  impaired. 

Mechanical  strength  may  deteriorate  due  t o fatigue  or  overstress;  electrical 
signals  may  be  mechanically  and  erroneously  modulated;  materials 
and  structures  may  be  cracked,  displaced,  or  shaken  loose  from  mounts; 
mechanical  functions  may  be  impaired;  finishes  may  be  scoured  by 
other  surfaces;  wear  may  be  increased. 

Mechanical  structures  may  be  overloaded  causing  weakening  or  collapse; 
items  may  be  ripped  from  their  mounts;  mechanical  functions  may 
be  impaired. 

Causes  heating  and  thermal  aging;  can  alter  chemical,  physical,  and  elec- 
trical properties  of  materials;  can  produce  gases  and  secondary  radi- 
ation; can  cause  oxidation  and  discoloration  of  surfaces;  damages 
electrical  and  electronic  components,  especially  semiconductors. 

Causes  heating  and  possible  thermal  aging;  surface  deterioration;  structural 
weakening;  oxidation;  acceleration  of  chemical  reactions;  and  alteration 
of  physical  and  electrical  properties. 

Causes  spurious  and  erroneous  signals  from  electrical  and  electronic  equip- 
ment and  components;  may  cause  complete  disruption  of  normal 
electrical  and  electronic  equipment  such  as  communication  and  mea- 
suring systems. 

Effects  similar  to  those  for  sunshine,  nuclear/cosmic  radiation,  and  thermal 
radiation. 

Albedo  radiation  is  reflected  electromagnetic  (EM)  radiation;  amounts  de- 
pend on  the  reflective  capabilities  of  illuminated  object  such  as  a 
planet  or  the  moon;  effects  are  the  same  as  for  other  EM  radiation. 

Disrupt  gravity-dependent  functions;  aggravates  high-temperature  effects. 
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TABLE  6-2  (Confd) 

ENVIRONMENTS  AND  TYPICAL  EFFECTS' 


Environment 
Magnetic  fields 


Insects 


Clouds,  fog,  smog,  smoke, 
haze,  etc. 


Acoustic  noise 


Effects 

False  signals  are  induced  in  electrical  and  electronic  equipment; 
interfered  with  certain  functions;  can  induce  heating;  can  alter 
electrical  properties. 

Can  cause  surface  damage  and  chemical  reactions;  can  cause  clogging  and 
interferencewith  function;  can  cause  contamination  of  lubricants  and 
other  substances. 

Can  interfere  with  optical  and  visual  measurements; deposition  of  moisture, 
precipitation,  etc.;  enhances  contamination;  can  act  as  an  insulator  or 
attenuator  of  radiated  energy. 

Vibration  applied  with  soundwaves  ratherthan  with  a mechanical  couple; 
can  cause  the  same  damage  and  results  as  vibrational  environment,  i.e., 
the  sound  energy  excites  structuresto  vibrate. 


TABLE  6-3 


ILLUSTRATION  OF  INTERACTING  ENVIRONMENTAL  EFFECTS' 


Salt 

Spray 

Vibration 

Low 

Temperature 

High 

Temperature 

High 

T emperature 

Accelerate 

Corrosion 

Inaease  Rate 
ofVtfear 

Mutually 

Exclusive 

Low 

T emperature 

Decelerate 

Corrosion 

Intensity, 
Fatigue, 
Rupture,  etc. 

Vibration 

No 

Interaction 

Salt 

Spray 

ature  inhibits  the  growth  of  fungi  and  rain 
dilutes  the  eorrosive  effeets  of  salt  spray. 

A good  tabulation  of  many  environmental 
faetors  and  equipments  is  presented  in 
Refs.  2 and  5. 

A less  frequent  effeet  oeeurs  when  one 
environmental  eondition  ereates  another,  e.g., 
when  areing  between  switeh  or  relay  eon- 
taets  eauses  the  formation  of  ozone,  thus 
ehanging  the  environment  and  its  effeets. 


Some  eonditions  cause  cumulative  non- 
reversible  changes  in  the  equipment;  there- 
fore, when  considering  equipment  behavior, 
the  history  of  environmental  exposures  must 
be  considered.  For  example,  heating  from 
welding  and  soldering  can  cause  permanent 
shifts  in  device  characteristics;  mechanical 
shock  can  result  in  permanent  dislocation  of 
a lead  or  a part;  and  nuclear  radiation  can 
cause  permanent  defects  in  semiconductor 
devices.  The  need  for  conditioning  items 
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prior  to  erivironmental  testing  to  simulate 
the  historical  effects  must  be  considered. 

This  conditioning  is  sometimes  necessary'  to 
assure  that  the  response  during  the  test  is 
representative  of  that  in  operational  use. 
Knowing  the  environmental  history  is  not 
important  when  the  effects  are  reversible, 
but  the  reversibility  of  all  important  re- 
sponses can  be  determined  only  through 
careful  analysis.  Ignoring  the  nonreversible 
effects  that  have  occurred  in  previous  tests 
and  operations  can  result  in  misleading  en- 
vironmental test  results.  Of  course,  these 
effects  may  be  difficult  to  assess  or  simu- 
late, but  just  knowing  of  their  existence  can 
be  very  valuable  for  the  test  designer. 

Experience  is  frequently  the  most  useful 
guide  for  selecting  the  environmental  factors 
and  the  severity  levels  and  combinations  of 
them  to  be  used  in  a test.  This  prior  know- 
ledge and  experience  can  help  reduce  the 
number  of  environmental  tests  needed  to 
ensure  the  successful  operation  of  the  item. 

The  difficulties  associated  with  common 
environmental  factors  - such  as  temperature, 
vibration,  and  thermal  shock  - nearly  al- 
ways receive  attention.  Less  familiar  factors 
can  sometimes  be  equally  or  even  more  im- 
portant, e.g.,  hail  and  insects  demand  special 
attention  to  determine  what  characteristics 
and  severity  levels  are  required.  With  hail, 
for  example,  if  mechanical  impact  damage 
is  the  major  effect,  the  size,  shape,  velocity, 
and  number  per  unit  area  of  the  simulated 
hailstones  are  the  important  characteristics. 
On  the  other  hand,  the  vibration  induced  by 
the  incident  hail  may  be  the  most  signifi- 
cant factor.  Insects  can  cause  both  mechan- 
ical and  chemical  damage,  and  both  charac- 
teristics must  be  evaluated. 

When  there  is  little  available  knowledge 
about  the  operational  environment  or  its 
effect  on  an  item,  it  is  often  simpler  and 
more  economical  to  test  and  see  what  hap- 
pens than  to  spend  a great  deal  of  time 


and  money  on  an  independent  study.  This 
is  essentially  the  “build-and-test”  approach, 
which  has  limited  value  for  large  and  ex- 
pensive items,  but,  when  used  with  discre- 
tion, it  can  be  useful  for,new  designs  or  for 
new  applications  of  old  designs. 

6-3  SIMULATING  ENVIRONMENTAL 
CONDITIONS 

The  emphasis  on  environmental  testing 
has  led  to  the  development  of  some  very 
elaborate  test  facilities  (Ref  1).  Several  good 
surveys  of  older  environmental  test  capabi- 
lities are  presented  in  Refs.  2 and  3.  The 
most  frequently  used  standard  for  military 
procurement  is  MlL-STD-810  (Ref.  4). 

It  is  not  always  possible  to  generate  com- 
plex conditions,  even  with  the  most  elabor- 
ate facilities.  Air  turbulence,  gases,  or  in- 
seet  conditions  can  be  difficult  to  simulate. 
Many  facilities  are  even  limited  in  their 
capability  to  generate  complex  temperature 
profiles. 

Because  of  these  problems,  a great  deal  of 
effort  has  been  devoted  to  developing  so- 
phisticated simulation  facilities.  But  there 
may  be  other  ways  to  resolve  the  question. 
First  of  all,  it  is  the  effect  of  the  environ- 
mental conditions  that  is  of  interest,  not 
just  the  conditions  themselves.  Therefore, 
substitutes  should  be  considered.  For  ex- 
ample, pebbles  might  be  used  as  a substitute 
for  hailstones  if  mechanical  damage  from 
impact  is  of  interest.  Or,  if  vibration  in- 
duced by  hailstones  is  of  interest,  then  a 
vibration  test  already  scheduled  may  be 
adequate. 

Some  effects  are  investigated  more  easily 
from  a more  fundamental  level.  Also,  the 
environmental  conditions  sometimes  may  be 
separable  into  fundamental  components.  For 
example,  a temperature  profile  may  be 
simulated  by  high  and  low  temperature 
levels  and  thermal  shock.  In  such  cases,  ef- 
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fects  such  as  nonreversibility  , interactions, 
and  aging  must  be  accounted  for. 

Elaborate  environmental  test  facilities  are 
not  always  required.  Simply  heating  indi- 
vidual circuit  components  near  a soldering 
iron  may  in  some  cases  be  more  informa- 
tive than  testing  the  entire  circuit  or  assembly 
in  an  oven.  And,  in  the  absence  of  eertain 
capabilities,  an  improvised  test  may  be  better 
than  none  at  all.  For  example,  mechanieal 
shock  may  be  simulated  by  dropping  the 
items  from  a prescribed  height. 

When  facilities  do  not  exist  for  generating 
combined  environments,  combined  environ- 
ment effects  must  be  simulated  by  using 
single  environments  in  sequence.  If  the 
severity  levels  of  the  environments  are  not 
set  deliberately  to  damage  the  equipment, 
the  order  of  application  is  determined  by 
whatever  is  most  convenient.  When  tests 
cause  damage,  the  order  of  environments 
must  be  considered  carefully.  First,  apply 
those  conditions  least  likely  to  damage  the 
specimen.  For  the  mechanical  part,  humidity 
and  salt  spray  tests  thus  logically  would  be 
applied  before  vibration  or  a mechanical 
load  test.  An  electronic  part  usually  would 
be  tested  by  applying  vibration  before  high 
temperature.  Such  test  sequencing  allows 
the  maximum  amount  of  information  to  be 
obtained  before  damage  occurs. 

Ordering  of  environments  for  items  eom- 
posed  of  both  mechanical  and  electrical  parts 
is  not  as  clear-cut.  The  same  basic  criterion 
still  applies,  and  the  ability  to  repair  the  item 
can  greatly  influence  the  ordering. 

If  both  single  and  combined  environmental 
conditions  can  be  generated,  it  does  not 
necessarily  follow  that  the  combined  testing 


is  preferable.  The  final  choice  of  an  ap- 
proach depends  on  what  is  to  be  accom- 
plished with  the  test  and  is  influenced 
strongly  by  factors  such  as  time,  cost,  skills, 
and  instrumentation. 

Combined  environment  testing  has  two 
significant  advantages  over  single  environ- 
ment testing: 

1.  The  ability  to  investigate  the  combined 
effects  of  multiple  conditions;  i.e.,  combined 
testing,  in  most  cases,  more  closely  approxi- 
mates the  real  environment. 

2.  Several  conditions  usually  can  be 
applied  simultaneously  in  a shorter  time  than 
in  sequence,  due  to  savings  in  set-up  time. 
Therefore,  combined  testing  often  saves 
money.  The  major  disadvantage  of  this  ap- 
proach is  that  the  initial  equipment  cost  for 
combined  testing  is  higher. 

In  qualification  and  acceptance  testing, 
combined  environments  are  preferable.  The 
increased  confidence  derived  from  the  know- 
ledge that  synergistic  effects  are  accounted 
for  frequently  permits  the  use  of  smaller 
safety  factors. 

When  testing  to  relate  cause  and  effect, 
combined  environment  testing  is  used  as  an 
extension  of  single  environment  testing. 
During  the  development  phase,  initial  testing 
usually  is  applied  to  determine  the  effeets 
of  single  environments.  Combined  environ- 
ments are  employed  after  single  environment 
effects  have  been  determined  and  eombined 
effeets  become  of  interest.  Single  environ- 
ment testing  also  may  be  preferable  in  long 
duration  tests  due  to  the  impracticality  of 
eommitting  eombined  environmental  test 
faeilities  for  long  periods  of  time. 
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CHAPTER  7 

ACCELERATED  TESTING 


LIST  OF  SYMBOLS 

A = acceleration  factor 

A = incremental  acceleration  factor 

Cdf  - Cumulative  distribution  function 

d = factor  for  Kolmogorov-Smimov 

test 

g,  b = state  of  a system 

G = equivalent  state  of  a system 

i = life 

MtF  = Median  time  to  Failure 

Pxo  ~ life:  10%will  fail  before  that  time 

s implies  the  word  “statistical(ly)”, 

or  implies  that  the  technical 
statistical  definition  is  intended 
rather  than  the  ordinary'  dictionary 
definition 

t = time 

T = absolute  temperature  (also  a sub- 

script); total  test  time 

E = random  variable 

X = failure  rate 

T - transformed  time 

* 

implies  an  unknown  parameter 
implies  a point  estimate 


7-1  INTRODUCTION* 

Accelerated  testing  is  a very  loosely  defined 
concept;  attempts  to  make  it  rigorous  gener- 
ally run  into  difficulties.  Loosely  speaking, 
accelerated  testing  started  when  someone 
said,  “Let’s  shoot  the  juice  to  it  and  see 
what  happens.”  This  means,  roughly,  “Let’s 
treat  it  worse  than  we  expect  it  to  be  treated 
in  ordinary  practice  and  then  see  what  hap 
pens.”  One  difficulty  is  that  treating-it- 
worse  does  not  always  mean  “shooting  the 
juice  to  it”.  For  example,  electrical  con- 
tacts behave  better  as  voltage  and  current 
are  increased  (up  to  a point)  and  some 
warmth  may  improve  matters  for  electronic 
equipment  by  helping  to  reduce  the  mois- 
ture problem. 

Accelerated  testing  in  this  qualitative 
sense  is  something  that  anyone  can  do  and 
that  everyone  does.  There  is  a reasonably 
firm  qualitative  foundation  for  much  of  it. 

It  is  in  the  quantitative  interpretation  that 
troubles  begin.  These  qualitative  and  quanti- 
tative uses  of  accelerated  testing  can  con- 
veniently be  put  into  four  classes: 

1.  Qualitative  - to  see  what  kinds  of 
failures  are  generated  and  to  decide  then  if 
a modification  is  worthwhile 

2.  Qualitative  - to  get  a rough,  quick 
idea  of  whether  or  not  something  can  stand 
the  gaff 


*Large  portions  of  this  chapter  are  adapted  from 
Refs  2 and  3 - they  are  similar  sinee  the  aeeelerated 
testing  portion  of  Ref.  2 was  written  bv  the  author  of 
Ref.  3. 
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3.  Qualitative  - to  see  what  happens 
when  the  user  maltreats  the  device  as  he 
probably  will 

4.  Quantitative  - to  make  a prediction 
about  the  life  under  actual  operating  con- 
ditions. 

There  is  little  question  that  accelerated 
testing  is  useful  for  the  3 qualitative  mea- 
sures; so  it  is  mainly  the  quantitative  prob- 
lem to  which  this  chapter  is  addressed. 

7-2  TRUE  ACCELERATION  (Ref.  3) 

Several  definitions’  for  true  acceleration 
appear  in  the  literature,  some  of  which  are 
not  very  explicit.  Most  engineers  associate 
true-acceleration  with  behavior  over  time. 

The  one  given  here  is  chosen  for  its  gener- 
ality and  applicability.  Acceleration  need 
not  be  true  to  be  useful  even  though  untrue 
acceleration  is  more  difficult  to  analyze, 
even  qualitatively. 

Acceleration  is  true  if  and  only  if  the  sys- 
tem, under  the  accelerated  conditions,  passes 
reasonably^  through  equivalent^  states  and 
in  the  same  order  it  did  at  the  usual  con- 
ditions. Let  g(t)  be  the  state  of  the  system 
under  usual  conditions  and  let  G(/)  be  the 
equivalent  state  of  the  system  under  acceler- 
ated damagers  ('Gis  not  the  state  at  the 
accelerated  conditions  but  is  the  state  after 
being  transformed  reversibly  down  to  the 
usual  conditions).  Then  there  is  true  accel- 
eration if  and  only  if: 

1.  G(Q  = g[r(Q] 

2.  r(0  is  a monotonically"*  increasing 
function  of  the  argument 

3.  G(0)  = g(0) 

4.  r(0)  = 05. 

The  acceleration  factor  A is  a defined  as 
A( t)  = t( t)!t.  An  incremental  acceleration 


factor  may  be  defined  as  A{t)  = driOldt. 

True  acceleration  is  illustrated  in  Figure 
7-1  (A)  for  a state  vector  with  a single  di- 
mension - resistance  ratio  of  a resistor. 

It  is,  of  course,  nice  if  Aft)  is  a constant 
with  respect  to  time  as  in  the  figure  and 
depends  in  some  quite  tractable  way  on  the 
severity  level. 

Estimates  of  an  acceleration  factor  will 
depend  on  the  statistical  procedures  used  to 
arrive  at  them. 

It  is  important  to  recognize  the  arbitrari- 
ness of  the  definition  especially  as  regards 
the  word,  reasonably.  In  order  to  have  true 
acceleration,  it  is  only  necessary  that  the 
things  in  which  we  are  immediately  interested 
be  close  enough  under  the  two  sets  of  con- 
ditions. To  be  specific,  not  all  failure  modes 
and  mechanisms  need  be  identical  down  to 
the  last  electron  orbital. 

Generally,  the  physical  condition  of  the 
device  will  be  included  in  the  system  state 
either  explicitly  or  implicitly  in  sufficient 
detail  to  permit  judgments  to  be  made  about 
its  design  and  construction  relative  to  the 
failure  modes  and  mechanisms. 

The  state  of  a system  is  not  uniquely  de- 
fined for  a physical  system;  it  is  defined  only 
for  a conceptual  model  of  the  system.  The 


‘ One  verj'  poor  choice  is  to  assert  that  acceleration  is 
true  if  and  only  if  it  follows  the  Arrhenius  equation.  An- 
other poor  choice  is  to  associate  it  with  the  constant 
hazard  rate. 

^ The  word  “reasonably”  is  necessary  because  the 
needs  and  desires  of  the  situation  may  be  different  from 
time  to  time,  and  as  engineers,  if  things  are  close  enough 
for  the  purposes  at  hand,  there  is  no  need  to  worry  about 
the  discrepancies  as  far  as  these  purposes  are  concerned. 

’Two  states  of  a system  are  equivalent  if  and  orrly  if 
one  can  be  reversibly  trarrsformed  into  the  other  by  chang- 
ing the  environment.  For  example,  a resistor  at  a higher 
temperature  rrright  never  have  the  same  resistance  it  would 
at  a lower  temperature,  solely  because  of  its  temperature 
coefficient.  This  is  illustrated  in  Fig.  7-l(B). 

'For  those  who  think  the  term  is  ambiguous,  mono- 
tonic is  used  here  in  the  strict  serrse,  i.  e.,  staying  constant 
is  not  allowed. 

’If  G and  g have  a one-to-one  correspondence  with  the 
argument  (the  reciprocal  function  exists),  this  is  a logical 
consequence  of  #1  and  #3. 
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tM  = 6t;  A = 6,  A = 6.  - 1 + lOar,  (g  Is  some  constant) 

<A)  Illustration  of  True  Acceleration  (see  text  for  notation) 


(B)  Equivalence  of  States 
Figure  7-1.  Accelerated  Tests 
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detailed  specification  of  the  system  state 
will  vary  with  our  needs  and  desires  and  with 
the  required  tractability  of  the  resulting 
equations.  The  state  of  a system  ordinarily 
will  have  several  dimensions  (components); 
so  it  can  be  classed  as  a vector.  For  example, 
consider  a resistor.  If  we  are  concerned  only 
about  its  resistance  and  nothing  else  then  the 
state  of  the  system  will  be  given  by  the  re- 
sistance of  the  device  (or  something  equiva- 
lent thereto  such  as  a ratio  of  the  resistance 
to  an  initial  resistance).  On  the  other  hand, 
we  may  be  concerned  about  the  resistance, 
the  temperature  coefficient  of  resistance,  the 
voltage  coefficient  of  resistance,  and  the 
chemical  composition  of  the  resistive  mate- 
rial. Then  there  will  be  several  dimensions 
for  the  system  state,  and  two  states  will  not 
be  the  same  unless  all  corresponding  dimen- 
sions are  pair-wise  the  same. 

Lest  one  be  concerned  that  associating 
a system  state  only  with  a system  model 
rather  than  with  the  system  itself  is  too 
sloppy,  an  analogy  can  be  made  to  thermo- 
dynamics. There  can  be  many  thermody- 
namic models  of  a system  depending  on  what 
is  of  concern.  The  entropy  is  not  defined  for 
the  system  itself  but  only’with  regard  to  a 
particular  thermodynamic  model  of  that  sys- 
tem. 

In  addition  to  verifying  that  true  acceler- 
ation exists,  a great  deal  of  effort  must  be 
expended  in  determining  the  acceleration 
function.  It  is  virtually  always  presumed 
that  the  acceleration  function  is  a constant. 

7-3  FAILURE  MODES  AND  MECHANISMS 

Some  gross  failure  modes  which  can  be 
accelerated  for  mechanical  parts  are  fatigue, 
corrosion,  creep -rupture,  stress  corrosion,  and 
various  combinations  of  them.  In  electron- 
ics, one  does  not  ordinarily  specify  the  gross 
failure  modes  for  acceleration,  but,  rather, 
specifies  the  “stresses”  which  are  being  in- 
creased. Some  of  these  are  temperature, 
supply  voltage,  power  dissipation,  vibration. 


humidity,  and  corrosive  elements.  There  is 
a large  body  of  material  in  the  mechanical 
and  metallurgical  fields  dealing  with  those 
gross  failure  modes.  Since  the  behavior  of 
electronic  components  is  organized  different- 
ly, there  is  no  organized  body  of  literature 
which  deals  with  gross  failure  modes  that  cut 
across  all  components.  A number  of  informa- 
tion sources  on  accelerated  testing  of  electron- 
ic components  are  available,  many  of  which 
are  listed  in  Ref  3 ; some  of  them  contain  con- 
ceptual errors  and  ought  to  be  read  critically. 
Ref  3 itself  is  dated  (as  are  its  references) 
because  it  was  issued  in  1968.  The  failure 
modes  of  semiconductors,  or  at  least  their 
relative  importance,  have  changed  drastically 
since  then. 

74  CONSTANT  SEVERITY-LEVEL 
METHOD 

This  is  the  traditional  type  of  accelerated 
test  in  which  the  seventy  level  remains  con- 
stant throughout  the  life  of  the  items  on 
test.  It  is  customary  to  run  tests  at  several 
severity  levels  and  to  plot  a curve  of  some 
parameter  such  as  failure  rate  vs  severity- 
level.  A sample  of  several  items  usually  is 
put  on  test,  and  the  test  stopped  when  some 
fraction  of  the  original  sample  has  failed  or 
a specified  test  time  has  elapsed.  For  re- 
liability prediction  purposes,  the  early 
fraction  that  fails  is  most  important  because 
only  the  short-lived  items  are  going  to  affect 
the  reliability  seriously. 

7-5  STEP-STRESS  AND  PROGRESSIVE- 
STRESS  METHODS 

The  word  “stress”  is  used  in  the  sense  of 
severity  level.  In  this  method,  the  severity 
applied  to  a sample  of  items  is  increased  in 
steps  or  increments  until  some  criterion  is 
met  for  terminating  the  test.  All  steps  do 
not  have  to  be  the  same  size,  even  though 
this  is  a common  practice. 

The  term  step-stress  used  in  the  literature 


74 


AMCP  706-198 


is  ambiguous.  It  is  couveuieut  to  classify 
step-stressiug  iuto  three  categories: 

1.  Large  steps  iu  which  the  steps  are 
presumed  high  euough  aud  loug  euough  so 
that,  for  a giveu  step,  the  damage  aceumul- 
ated  at  all  previous  steps  is  uegligible. 

2.  Small  steps  iu  which  the  steps  are 
small  euough  so  that  iu  the  aualysis  oue  eau 
presume  with  uegligible  error  that  the  severity 
level  is  steadily  iucreasiug.  This  is  theu  just 
the  progressive-step  case;  iu  progressive-stress 
the  stress  iucreases  at  a coustaut  rate. 

3.  Medium  steps  for  which  the  assump- 
tious  for  ueither  small  uor  large  steps  are 
valid.  The  cumulative  damage  at  previous 
steps  must  be  taken  iuto  account,  but  the 
steps  are  not  small  enough  that  the  severity 
level  can  be  considered  to  be  continuously 
increasing . 

In  addition,  the  following  terminology  is 
used:  large/step-stress,  medium/step-stress, 
and  small/step-stress.  The  size  designations 
are  not  absolute,  but  are  relative  to  the  kind 
of  analysis  that  must  be  performed. 

Large/step-stress  tests  are  analyzed  as  if 
they  were  constant-stress  tests  being  run  at 
the  severity  level  of  the  last  step.  Parts  that 
are  very  expensive  or  otherwise  diffieult  to 
acquire  or  test  often  are  treated  in  this  way. 
Often  a sample  of  only  one  is  used.  It  is 
wise  to  consider  the  results  as  “ballpark” 
figures,  since  the  necessary  assumption  that 
the  effects  of  previous  steps  are  negligible  is 
likely  to  be  in  error.  Preliminary  tests  often 
are  run  in  this  way  and  are  followed  by  more 
comprehensive  set  of  tests  later  on. 

Small/step-stressing  is  analyzed  in  the  same 
way  as  progressive-stressing,  and,  in  faet, 
by  definition,  there  is  really  no  distinction 
between  them.  In  many  cases,  there  may  be 
an  economic  advantage  to  choosing  either 
very  small  step  increments  or  a continuously 


increasing  stress.  For  example,  if  extremely 
accurate  voltage  steps  are  desired,  a stepping 
switch  might  be  used  with  a voltage  divider; 
otherwise,  a slow  motor  might  be  used  to 
turn  a multiturn  potentiometer. 

Less  testing  time  is  the  major  advantage  of 
step-stress  tests  over  constant-stress  tests.  A 
direet  comparison  of  the  methods  requires 
an  assumption  of  a theory  of  cumulative 
damage  (see  par.  7-6).  In  the  area  of  metal 
fatigue,  there  are  many  theories  of  cumu- 
lative damage.  In  electronics,  a simple  linear 
model  is  assumed  most,often  because  of  its 
simplicity  and  the  lack  of  knowledge  of  the 
aetual  processes. 

A linear  model  of  cumulative  damage  is  a 
gross  approximation.  In  some  circumstances, 
it  eonsistently  underestimates  and  in  other 
eireumstances,  consistently  overestimates  the 
correct  results.  Regardless  of  these  deficien- 
eies,  it  offers  the  advantages  of  being  tract- 
able, easily  remembered,  and  widely  used. 

So  use  the  linear  model  unless  you  know  of 
some  other  which  is  better.  But  remember 
the  arbitrariness  of  any  assumption. 

An  important  parameter  in  step-stress 
testing  is  the  ratio  of  severity  step  size  to  the 
time  at  eaeh  level.  This  controls  the  rate  of 
inerease  of  the  stress  severity  and  is  the  para- 
meter that  is  varied  when  running  several 
tests  on  a partieular  population  of  items. 

For  some  kinds  of  items,  the  maximum 
useful  severity  level  will  be  exeeeded  before 
the  deviee  fails  in  the  proper  mode.  For 
example,  on  thermally  stressed  transistors 
there  are  sometimes  euteetie  points  where 
melting  oeeurs  and  the  transistor  essentially 
eeases  to  be  a transistor.  If  this  happens, 
the  rate  of  inereasing  the  stress  severity 
must  be  deereased.  The  slope  of  the  steps 
during  the  eourse  of  the  tests  also  can  be 
modified.  The  severity  level  limits  (i.e.,  the 
level  where  the  deviee  ceases  to  function  in 
its  usual  manner)  are  an  important  limitation 
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to  step-stressing.  There  are  other  cases 
where  the  failure  mode  changes  so  drastically 
at  some  level,  that  it  is  senseless  to  continue 
testing  above  that  level. 

Another  advantage  of  step-stress  testing 
is  the  elimination  of  “switch-on”  problems, 
such  as  initial  transients  and  failures  due  to 
high  stress  rates.  This  is  because  the  severity 
level  is  low  at  the  beginning  and  the  se\erity 
increase  is  gradual.  The  severity  level  need 
not  begin  at  “zero”  (i.e.,  a level  near  benign). 
This  can  save  time  and  reduce  the  amount 
of  cumulative  damage  at  severity  levels  other 
than  the  failure  level.  Some  programs  con- 
cerned with  investigating  cumulative  damage 
theories  may  change  the  seventy  level  only 
once  during  a test.  For  example,  the  initial 
part  of  one  test  may  be  at  a high  severity 
level  and  the  remainder  at  a low  severity 
level;  a subsequent  test  reverses  the  procedure. 
Not  much  work  of  this  sort  is  done  in 
electronics,  but  metallic  fatigue  is  a field  in 
which  these  methods  of  programming  stresses 
have  received  considerable  attention. 


7-6  CUMULATIVE  DAMAGE 

In  order  to  compare  tests  (or  field  ex- 
perience) run  under  different  severity-level 
programmings,  some  model  of  cumulative 
damage  is  necessary.  No  particular  model  is 
required,  merely  some  model.  In  electronics 
there  are  very  few  theories  of  cumulative 
damage,  regardless  of  the  part,  but  in  mech- 
anical fatigue,  for  example,  there  are  many 
models  of  cumulative  damage.  Most  often 
such  a model  uses  constant-“stress”  test 
as  its  basis.  The  most  common  conceptual 
model,  in  almost  any  field,  for  cumulative 
damage  is  the  so-called  linear  model.  It  has 
one  basic  assumption,  i.e.,  the  rate  of  doing 
damage  is  \jMtF  where  MtF  is  the  Median 
time  to  Failure* . The  MtF  is  for  the  parti- 
cular severity  level  at  which  damage  is  ac- 
cumulating. There  are  several  corollaries^  tp 
this  assumption  which  often  are  (but  impro- 
perly) stated  as  additional  assumptions: 


1.  The  rate  of  doing  damage  does  not 
depend  on  the  amount  of  damage  already 
done. 

2.  The  order  in  which  the  severity  levels 
are  applied  makes  no  difference. 

3.  The  total  damage  is  the  simple  sum  or 
integral  of  the  damage  done  at  each  stress 
level. 

4.  The  rates  of  doing  damage  are  inde- 
pendent of  each  other  for  different  severity 
levels. 

5.  The  Median’  endurance  at  constant 
severity  level  is  unity. 

With  regard  to  Corollary  No.  5,  the  actual 
endurance  is  1 + £,  where  £ is  a random  vari- 
able; its  statistical  properties  depend  on  the 
programming  of  the  severity  levels,  on  the 
probability  distributions  of  the  times  to 
failure  at  each  severity  level,  and  on  the  per- 
centage chosen  in  footnote  2.  It  usually  is 
presumed  that  the  calculated  life  is  the 
Median  (or  the  percentage  in  footnote  2). 

The  use  of  a cumulative  damage  model 
does  not  necessarily  mean  that  the  failure 
modes/mechanisms  were  the  same  at  each 
severity  level,  although  such  a case  may  help 
the  validity  of  the  model.  Example  No.  32 


' The  Median  (i.e.,  50th  percentile)  is  the  conventional 
fraction  to  use.  One  could  as  easily  use  some  other  per- 
centile, e.g.,  1%  (1%  have  lives  less  than  the  given  time). 
The  percentile  in  the  definition  and  in  corollary  5 must 
agree,  of  course. 

‘Corollaries  1,  2,  4 are  tree  because  the  damage  rate 
depends  only  on  MtF,  not  on  time  (for  No.  1)  nor  on  s 
severity  level  order  (for  No.  2)  nor  on  the  value  of  MtF 
for  some  other  severity  level  (for  No.  4).  Corollary  3 
is  tree  because  total  damage  D is 


Corollary  5 is  true  since  the  median  time  to  failure,  at  a 
given  severity  level  is  MtF,  by  hypothesis;  the  total 
(median)  damage  is  damage-rate  iUMtF)  multiplied  by 
time  MtF  which  is  unity. 
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Example  No.  32 


Life  cf  a Transistor  when  the  Temperature  Fluctuates 
Assumptions : 

1.  The  curve  of  life  (appropriate  percentile)  vs  temperature  (at  constant  tem- 
perature) is  known. 

2.  The  severity  level  can  be  completely  characterized  by  a temperature. 

3.  Linear  cumulative  damage  is  appropriate. 

4.  No  new  failure  modes,  which  would  decrease  the  life,  are  introduced  by  the 
temperature  changes.  (In  the  theoretical  development,  this  is  irrelevant  since  No.  3 
determines  the  method  of  calculation.  But  when  wondering  whether  or  not  No.  3 ap- 
plies, this  is  something  to  consider.  ) 

Let  the  Pjo  life  (10%  will  fail  before  that  time)  be  given  by  the  life  curve.  Fig. 

7-2,  and  the  temperature  profile  be  a regularly  repeating  pattern  as  shown  in  Fig. 

7-3. 


illustrates  the  linear  cumulative  damage 
hypothesis. 

Table  7-1  can  be  developed  from  theFj  ,life 
curve  and  the  temperature  profile. 

The  damage  rate  is  the  reciprocal  of  Fjo  hfe. 
The  fraction  of  damage  has  units  of  10'® 

T/hr  where  L is  the  presumed  equivalent 
Fio  life.  This  fraction  is  calculated  by  multi- 
plying the  numbers  in  the  2 preceding 
columns.  It  is  from  the  total  of  fraction- 
of-damage  column  that  L is  calculated,  i.e., 
the  total  must  be  unity.  From  the  life 


cune,  it  can  be  showm  (for  w'hat  it  is  worth) 
that  a constant  temperature  of  162°C  would 
give  the  same  P\o  life.  It  is  interesting  to 
compare  the  “%  life  column"  with  the  “% 
damage  column”,  e.g.,  at  350®C,  15%  of  the 

life  causes  43%of  the  damage;  while  at  50°C, 
40%  of  the  life  causes  less  than  4%  of  the 
damage. 


From  the  remarks  earlier  in  this  paragraph 
it  should  be  remembered  that  L = 42.9  X 


TABLE  7-1 


PERCENT  DAMAGE  VS  TEMPERATURE 


Temp 

Pio  life 

Fraction  of  Life 

Damage  rate 

Fraction  of  Damage 

°C 

10  hr 

hr/period 

% 

10-*/hr 

10‘*  c/hr 

% 

actual 

50 

5.0 

10  + 6 

40 

0.20 

0.08 

3.4 

100 

1.0 

4 

10 

1.0 

0.10 

4.3 

150  . 

0.50 

8 

20 

2.0 

0.40 

17.2 

250 

0.20 

6 

15 

5.0 

0.75 

32.2 

350 

0.15 

6 

15 

6.7 

1.00 

42.9 

equivalent 

162 

L = 0.429 

40 

100 

2.33 

2.33 

100 

7-7 


AMCP  706-198 


10*  hr  will  not  be  the  actual  Pio  life,  but  is 
presumed  to  be  close  to  it. 


7-7  APPLICATIONS 

Accelerated  life  tests  can  be  used  in  pro- 
grams operating  under  tight  and  critical 
schedules.  If  production  begins  before  re- 
search and  development  is  completed,  some 
assurance  must  be  obtained  quickly  that  the 
equipment  has  an  adequate  lifetime  and  that 
no  gross  design  weaknesses  exist.  Life 
tests  often  take  too  long  to  be  used  under 
these  conditions. 

Accelerated  testing  also  is  used  when  re- 
pair parts  must  be  manufactured  simultane- 
ously with  a short  run  production  program. 
In  this  case,  failure  rate  data  cannot  be  pro- 
vided quickly  enough  by  life  testing  to  in- 
fluence the  analysis  of  the  repair  comple- 
ment. 


In  some  cases  (explosives,  for  example), 
the  earliest  times  to  failure  in  the  storage 
environment  and  variations  in  times  to 
earliest  failure  must  be  known  with  high 
accuracy.  A large  sample  would  have  to  be 
kept  in  storage  in  a usual  life  test.  This 
would  be  very  expensive  and  time  consum- 
ing. Accelerated  testing  of  critical  failure 
modes  can  be  used  to  determine  the  range 
of  variability  of  the  time  to  failure,  with 
useful  accuracy,  with  a smaller  sample  than 
that  required  for  usual  life  testing.  For 
example,  solid  rocket  propellants  are  sub- 
ject to  catastrophic  failure  modes  that  may 
result  in  explosions.  The  remaining  life  in 
a stored  lot  must  be  estimated  periodically, 
generally  every  six  months  or  a year.  The 
aged  samples  must  be  subjected  to  acceler- 
ated aging  in  order  to  determine  whether 
some  critical  failure  mode  is  about  to  be 
triggered. 


Accelerated  tests  can  be  implemented  by 
speeding  up  the  duty  cycle  or  the  environ- 
mental level  or  both.  The  environments 
must  be  cycled  from  extreme  to  extreme  in 
order  to  reproduce  in  a short  time  the  de- 
gradation expected  over  the  period  of 
actual  service  life.  The  environmental  factor 
selected  for  acceleration  is  determined  by 
the  item  tested  and  its  failure  modes.  For 
example,  for  many  mechanical  components, 
failure  is  caused  by  mechanical  wear;  hence, 
the  acceleration  is  obtained  by  increasing 
the  frequency  and  severity  of  stress. 

The  failure  data  at  usual  environmental 
levels  and  those  at  accelerated  environments 
must  correlate  in  some  way  with  the  stresses 
actually  applied.  A precise  statistical  cor- 
relation frequently  cannot  be  obtained  be- 
cause much  of  the  theory  of  accelerated 
testing  is  still  very  crude.  In  such  cases, 
accelerated  environmental  tests  may  permit 
a great  deal  of  intuitive  information  to  be 
developed. 

Statistieal  eorrelation  often  ean  be  ob- 
tained with  aeeelerated  duty  eyele  testing. 
The  expeeted  number  of  eyeles  of  aetual 
seiviee  in  a given  time  period  often  ean  be 
estimated.  Aeeelerated  testing  is  performed 
by  increasing  the  number  of  eyeles  in  a 
given  time  period  and  measuring  the  mean- 
eycles-to-failure.  The  mean  cycles  between 
failures  (MCBF)  at  the  accelerated  duty 
cycle  frequently  can  be  related  to  the  MCBF 
at  normal  duty  cycles  as  a function  of  the 
ratio  of  cycles  per  time  period. 

7-8  PARAMETRIC  MATHEMATICAL 
MODELS 

The  ideal  accelerated  test  should  include 
(Ref  1): 

1.  An  algorithm  for  converting  the  re- 
liability data  observed  at  accelerated  con- 
ditions to  reliability  data  at  normal  con- 
ditions 
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2.  A statistically  sound  empirical  proof 
of  the  algorithm 

3.  A physical  model  explaining  the  al- 
gorithm. 

Unfortunately,  most  aeeelerated  test  teeh- 
niques  do  not  meet  these  eriteria.  They 
tend  to  be  approximate  and  require  a great 
deal  of  engineeringjudgment  in  the  absenee 
of  precise  physieal  models  or  statistieal 
techniques.  Some  diseussions  in  the  litera- 
ture are  vague  and  ambiguous;  the  word 
“life”  may  mean  the  random  variable,  or 
may  refer  to  the  mean  life,  or  may  not  mean 
anything  speeifie.  Beware  of  using  aeeeler- 
ation  faetors  from  the  literature,  for  speeifie 
eomponents.  The  state  of  the  art  in  eom- 
ponents  ehanges  rapidly  enough  so  that 
failure  modes  and  their  aeeeleration  factors 
can  be  expeeted  to  ehange  in  some  non- 
apparent  way. 

Temperature  is  the  most  common  method 
of  aeeelerating  a test;  usually  the  scale  para- 
meter of  the  distribution  is  presumed  to 
follow  the  Arrhenius  law  (see  Eq.  7-1). 
Voltage  can  be  increased  for  some  kinds  of 
capacitors,  and  power  dissipation  can  be 
increased  to  shorten  the  life  of  many  elec- 
tronic components.  Mechanical  excitations, 
such  as  vibration  and  shock,  are  sometimes 
used. 

In  the  parametric  approach,  the  parame- 
ters of  the  failure  distribution  are  presumed 
to  change  in  a deterministic  fashion  with  the 
“stress”.  The  functional  relationship  of  the 
“deterministic  fashion”  is  presumed  known, 
and  the,  purpose  of  the  test  is  to  evaluate 
the  parameters  in  that  relationship. 

The  most  common  situation  is  the  con- 
stant failure  rate  and  the  Arrhenius  tem- 
perature law  as  shown  in  Eq.  7-1. 


where 

= failure  rate  at  T 

T = absolute  temperature 

Xo,T*  = unknown  parameters 

kT*  - so  called  activation  energy, 

where  k = Boltzmann  constant 

To  - fixed  known  temperature 

Eq.  7-1  can  be  put  in  other  algebraically 
equivalent  forms. 

Where  a failure  distribution  has  2 para- 
meters, it  is  most  common  to  assume  that 
one  of  them  is  independent  of  the  acceler- 
ating “stresses”.  Other  assumptions  tend 
to  be  intractable,  even  if  more  realistic.  In 
the  s-normal  or  lognormal  distributions,  the 
median  usually  is  assumed  to  be  a function 
of  the  “stresses”,  and  the  other  parameter 
to  be  a constant. 

No  matter  what  distribution  is  assumed, 
it  is  essential  that  the  statistical  uncertainty 
in  the  results  be  estimated  and  clearly 
stated  - because  this  uncertainty  is  usually 
so  large  as  to  greatly  reduce  the  impact  of 
the  nominal  conclusions.  In  fact,  one  is 
often  tempted  to  remark,  “1  could  have 
guessed  that  close  without  the  tests!”.  For 
example,  using  Eq.  7-1  and  some  reasonably 
high  temperature  tests,  the  uncertainty  in 
failure  rate  at  operating  temperatures  might 
be  a factor  of  1 0 or  so. 

Refs.  3 and  4 give  some  examples  of  the 
applieation  of  Eq.  7-1  to  real  data.  The 
maximum  likelihood  equations  for  the 
solution  of  the  problem,  and  the  computer 
FORTRAN  program  to  effect  the  solution, 
are  also  given  there. 

Example  Nos.  33  and  34  illustrate  the 
procedure.  These  two  examples  show  how 
grossly  misleading  it  can  be  to  give  only 
point  estimates. 
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7-9  NONPARAMETRIC  MATHEMATICAL 
MODELS 


Suppose  it  is  known  that  the  time  scale 
factor  is  k times  worse  under  certain  severe 
operating  conditions.  Then  if  accelerated 
tests  are  run  under  those  severe  conditions, 
the  Cdf  of  the  time-to-failure  under  usual 
operating  conditions  can  be  estimated  in  a 
rather  short  time.  It  will  be  as  if  time  w'ere 
passing  k times  as  fast  as  usual. 


Generally,  it  is  the  early  failures  that 
are  important  because  they  show  the  early 
part  of  the  failure  distribution.  If  several 
items  are  put  on  test  at  the  same  time,  the 
early  part  of  the  Cdf  can  be  estimated  from 
the  first  few  failures,  regardless  of  the  form 
of  the  distribution. 

See  for  example,  pars.  2-2  and  2-5. 

Example  Nos.  35  and  36  illustrate  the  pro- 
cedure. 
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Example  No.  33 


Capacitor  life  test,  fixed  calendar  time  at  each  temperature.  The  table  shows 
the  test  conditions  and  the  raw  failure  data. 


Temperature, 

"C 

Number  rf 
devices 

Total -test- 
time, (10®  hr) 

Number  of 
failures 

25 

100 

0.2688 

1 

70 

100 

0.2688 

0 

125 

100 

0.2688 

4 

145 

100 

0.2688 

12 

The  activation  energy  was  estimated  to  be  0.10  to  0.62  eV;  the  failure  rate  at 
25°C  was  estimated  to  be  0.04  to  10  per  10®  hr;  the  range  for  each  is  for  a total  cf  4 
standard  deviations. 

The  point  estimates  are  0.363  eV  and  0.633  per  10®  hr.  If  only  point  estimates 
had  been  given,  they  would  have  been  very  misleading.  In  truth,  one  knows  relatively 
little  about  the  25  "C  failure  rate  of  the  capacitors,  or  how  the  failure  rate  changes 
with  temperature. 
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Example  No.  34 

Npn  planar  silicon  transistors,  life  test.  There  were  2 classes  for  failure 
modes:  ionic  and  all- other;  the  results  are  shown  for  ionic  only,  and  for  all  failures 
combined.  The  table  shows  the  test  conditions  and  the  raw  failure  data. 


Temperature,  °C 

Total -test -time, 
10®  hr 

Failures 
all  ionic 

175 

0.125 

0 

0 

200 

1.816 

1 

0 

220 

0.125 

0 

0 

240 

0.125 

0 

0 

265 

0.123 

3 

3 

290 

0.104 

13 

13 

320 

0.102 

17 

12 

350 

0.084 

38 

6 

The  results  follow;  the  range  is  for  a total  of  4 standard  deviations: 

1.  All  failures: 

a.  activation  energy  0.85  to  1.22  eV 

b.  failure  rate  at  25°C  0.01  to  13.9  per  10^^  hr 

2.  Ionic  failures  only: 

a.  activation  energy  0.61  to  0.98  eV 

b.  failure  rate  at  25  "C  0.47  to  635  per  10^^  hr. 
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Example  No.  35 


A newly  designed  motor-generator  set  must  be  tested.  Suppose  that  under  severe 
conditions  of  temperature,  humidity,  and  load,  that  the  rate  of  degradation  is  90  times 
as  bad  as  under  ordinary  conditions;  i.  e.,  the  time  acceleration  factor  is  90.  Ten 
items  are  put  on  test;  the  first  2 failures  are  at  26.7  hr  and  43.2  hr,  respectively. 
Estimate  the  actual  Cdf. 

Procedure  Example 


1.  Use  the  Kolmogorov  s- 
confidence  limits  in 
par.  2-5.  Calculate 
the  times-to-failure 
under  usual  conditions. 


1.  Acceleration  factor  = 90, 

= 90  X 26.7  hr  = 2403  hr 
t2  = 90  X 43.2  hr  =3888  hr. 


2.  Find  the  90%s-confi-  2.  </  = 0.37  for  90%s-confidence. 
dence  d from  Table 
2-12, 


3.  Use  Eq.  2-48  to  cal- 
culate the  envelope  for 
the  Cdf  where  i = fail- 
ure number  and  N = 
sample  size. 


3.  a.  For  i = 1:  Fhi  = 1/10  = 0.10,  Flo  = 0/10  = O.OO; 
thus  for  0 s f < fj,  the  upper  limit  for  the  Cdf 
is  0.10  +0.37  =47%,  and  the  lower  limit  is  0. 

b.  For*  =2:  Fhj  = 2/10  = 0.  20,  Flo  = 1/10  = 0.10; 
thus  for  t\  the  upper  limit  for  the  Cdf 

is  0.20  +0.37  =57%,  and  the  lower  limit  is 
still  0. 


As  with  all  tests  involving  only  a few  specimens,  the  results  are  discouragingly 
imprecise. 
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Example  No.  36 

Same  as  Example  No.  35,  but  suppose  that  the  failure  rate  is  constant.  Estimate 
the  failure  rate  and  the  Cdf  at  the  2 failure  times.  The  test  was  stopped  at  the  second 
failure. 


Procedure 

1.  Calculate  the  total-test-time. 
State  the  number  of  failures. 

2.  Estimate  the  failure  rate. 

3.  Use  Table  2-8  to  get  sym- 
metrical 2-sided  90%s-con- 
fidence  limits  forX. 


4.  Calculate  the  Cdf  limits  at 
2403  hr  and  at  3888  hr. 


Example 

1.  T = lOx  2403  hr  + 9 X 3888  hr 

w 59  X 10®  hr. 

2.  X = 2/(59  X 10®  hr)  = 33.  9/l0®-hr 

3.  The  5%and  95%levels  are  used  (95%  - 5% 

= 90%).  There  are  2 failures.  The  factors 
are  0.18  and  2.4. 

Slower  = 018  X 33.  9/l0®-hr  = 6.  l/l0®-hr 
\pp^  = 2.4  X 33.  9/l0«  hr  = 8l/l0®-hr. 

4.  At  2403  hr: 

upper  Cdf  = 1 — exp  (-  8 1 x lO"®  x 2403)  « 18% 

lower  Cdf  = 1 — exp  (—6.1  x 10"®  x 2403) 

« 1.4% 

At  3888  hr: 

upper  Cdf  = 1 “ exp  (-  81  x ® x 3888)  « 27% 

lower  Cdf  = 1 -exp(-  6.1  x 10'®  x 3888) 

« 2.3%. 


This  is  less  uncertain  than  in  Example  No.  35  (due  to  the  use  of  parameters  in 
this  example)  but  is  still  not  very  good. 
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CHAPTER  8 

NONDESTRUCTIVE  EVALUATION 


8-1  INTRODUCTION 

Nondestructive  evaluation  (NDE)  does  not 
degrade  the  item  to  which  it  is  applied;  the 
phrase  “nondestructive  testing”  (NDT)  is  used 
to  describe  similar  activities,  but  is  usually 
considered  to  be  less  general  than  NDE. 
Techniques  such  as  infrared  scanning  and 
X-ray  radiography  can  be  employed  to: 

1.  Prevent  destruction  of  items  while 
measuring  properties  that  usually  would  re- 
quire destruction  if  measured  by  conventional 
techniques,  and/or 

2.  Permit  certain  measurements  to  be  made 
more  rapidly  and  conveniently  than  con- 
ventional techniques  allow. 

The  major  application  areas  of  NDE  are 
illustrated  in  Table  8-1.  In  research  and 
development,  NDE  can  be  used  to  measure  and 
evaluate  special  properties  of  materials.  Use- 
ful process  control  information  can  be  gen- 
erated from  NDE  which  monitors  the  pro- 
duction process.  NDE  is  valuable  in  quality 
control  where  items  and  materials  can  be 
evaluated  without  destructive  sampling.  NDE 
also  can  be  used  to  measure  wear  and  deteri- 
oration of  in-service  items. 

In  NDE,  items  are  observed,  measured,  ex- 
posed to  X rays,  magnetized,  vibrated, 
acoustically  excited,  heated,  etc.  No  one  fonn 
of  energy  nor  any  one  NDE  method  can 
answer  all  NDE  requirements.  Each  technique 
has  its  limitations  and  many  of  the  methods 
complement  one  another.  On  some  projects, 
it  may  be  necessary  to  develop  a special  NDE 


method  in  parallel  with  the  development  of 
the  system  to  be  tested. 

Most  NDE  methods  do  not  measure  a param- 
eter or  characteristic  directly,  but  measure 
some  more  easily  observ'ed  phenomenon  that 
can  be  correlated  with  the  desired  character- 
istic. For  example,  the  uniformity  of  a 
material  can  be  inferred  by  observing  magnetic 
flux  perturbations  or  ultrasonic  energy  re- 
flections. On  the  other  hand,  methods  like 
X-ray  radiography  permit  more  direct  ob- 
seiv  ation.  Table  8-2  summarizes  typical  char- 
acteristics of  many  NDE  methods. 

8-2  OPTICAL  METHODS 

Optical  techniques  use  microscopes,  magni- 
fying glasses,  interferometers,  etc.  to  detect 
the  presence  of  surface  flaws,  anomalies,  and 
malfunctions.  A permanent  record  of  surface 
conditions  and  outward  appearance  can  be 
obtained  by  photography.  This  method  can 
provide  excellent  permanent  records,  but  can 
only  detect  and  record  surface  phenomena. 

Microscopes  provide  a maximum  magnifi- 
cation on  the  order  of  2000  with  field-of-view 
and  depth-of-field  decreasing  with  increasing 
magnification.  Interferometer  microscopes 
offer  depth  measurements  in  the  low  micro- 
meter region.  The  capabilities  of  the  micro- 
scopic approach  are  greatly  expanded  by 
using  electron  microscopes. 

Optical  microscopy  and  photographic 
techniques  can  be  combined  to  produce 
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TABLE  8-1 

APPLICATIONS,  FUNCTIONS,  AND  EXAMPLES  OF  NDE* 


Areas  of 
AoDlication 

Function  Performed 

Examples 

Research  and 
Development 

Evaluating  materials,  components,  and 
parts;  comparing  and  evaluating  fabrication 
and  assembly  techniques;  data  acquisition. 

Measuring  fatigue  in  metals,  de- 
tecting cracks  in  welds,  and  non- 
bonds in  bonded  materials. 

Process 

Control 

Measuring  process  variables  and  providing 
control  information 

Radioisotopethickness  gauging. 

Quality 

Control 

Detecting  and  locating  anomalies  in 
materials,  defective  parts,  etc.;  detecting 
and  locating  fabrication  and  assembly  de- 
fects; evaluating  the  production  process. 

Poor  adhesive  bonding,  cracks  in 
welds,  contaminated  transistors, 
non-uniform  porosity  in  metals. 

In-service 

Evaluation 

Detecting  flaws,  defects,  wear,  and  de- 
terioration of  items  in  field  usewithout 
major  disassembly. 

Locating  corrosion  inside  gas  tanks, 
detecting  moisture  in  bonded  wing 
structures  on  aircraft,  etc. 

photomicrographs  - photographs  taken 
through  microscopes.  Fiber  opties  technology 
can  be  used  to  observe  and  reeord  information 
in  otherwise  inaeeessible  areas,  sueh  as  the  in- 
side of  fuel  tanks  or  eompleted  wing  struc- 
tures. Wide-angle  and  long-range  photography 
permit  a large  amount  of  information  to  be 
recorded.  High-speed  photography  can  pro- 
duce records  of  the  dynamic  characteristics 
of  a material  or  item.  Optical  equipment  is 
available  on  an  off-the-shelf  basis  from  many 
sources. 

Optical  holography  is  a rapidly  expanding 
field  for  NDE,  providing  3-dimensional 
imaging  (Ref.  8),  and  offers  substantial  pro- 
mise. It  is  generally  quite  complex  and  will 
require  experts  in  the  field. 

8-3  RADIOGRAPHY 

Radiography  is  a method  for  examining  the 
bulk  of  solid  objects.  A radiographic  system 
includes  three  major  components:  the  radi- 
ation source,  the  radiation  detector,  and  the 
material  or  item  to  be  inspected.  The  basic 
arrangements  of  these  components  are  il- 


lustrated in  Fig.  8-1.  The  arrangement  in 
Fig.  8-1  (A)  is  the  more  common.  Radiation 
passes  through  the  object  onto  a film  or  other 
radiation  detector.  The  presence  of  flaws, 
anomalies,  and  foreign  objects  is  revealed  by 
the  image  or  detector-output;  it  is  a shadow- 
casting  process.  In  the  other  arrangement,  the 
source  and  the  detector  are  placed  on  the 
same  side  of  the  material  (Fig.  8-l(B));  radi- 
ation passes  through  the  detector  and  strikes 
the  material,  causing  scatter  or  secondary 
emissions  which  are  then  detected. 

Both  nuclear  and  atomic  radiation  are  used 
in  radiographic  NDE.  Some  important 
characteristics  of  this  technique  are  sum- 
marized in  Table  8-3. 

X-  and  gamma  radiation,  using  sensitive 
film  detectors,  are  widely  used.  These  methods 
can  detect  defects  on  the  order  of  1%  of  the 
material  thickness.  Procedures  have  also  been 
developed  which  use  the  Polaroid  and  Xero- 
radiographic  processes.  Color  radiography  is 
available;  this  technique  permits  hue  and 
saturation  to  be  distinguished,  in  addition  to 
brightness,  so  that  areas  of  opacity  can  be 
distinguished  more  easily. 
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CHARACTERISTICS  OF  POPULAR  NDE  METHODS' 


Method  Advantages  Disadvantages  Application 


Optical 

Applicable  to  almost  any 
item;  both  dynamic  and 
static  measurements; 
versatile. 

Can  detect  surface  phenomena 
only;  sometimes  requires  a 
delay  (development  of  photo- 
graphs). 

Surfaces  of  materials  and 
items;  interior  of  vessels  and 
compartments  (fiber  optics). 

Radio- 

graphy 

Can  detect  hidden  and  in- 
ternal defects;  both  static 
and  dynamic  measurements. 

Requires  expensive  and  com- 
plex equipment;  sometimes 
presents  a radiation  safety 
hazard. 

All  materials  not  adversely 
affected  by  the  incident 
radiation;  moving  machinery; 
enclosed  objects;  internal 
characteristics. 

Thermal 

Provides  temperature  pro- 
file of  a surface  or  area 
during  operation;  rapid; 
very  sensitive  (R). 

Sometimes  requires  applica- 
tion and  removal  of  special 
materials;  permanent  rec- 
ords are  difficult  to  obtain 
(except with  IR). 

Surfaces  of  material  and 
Items  not  damaged  by  appli- 
cation of  the  coating;  very 
small  surfaces  such  as 
microcircuits  (I  R) 

Magnetics 

Can  locate  flaws  or  defects 
in  assembled  equipment; 
rapid  and  simple  to  apply; 
sensitive. 

Applicableto  only  magnetic 
materials. 

Surface  of  metals;  wires, 
tubes,  etc. 

Liquid 

Penetrants 

Inexpensive  and  simple. 

Requires  application  and  re- 
moval of  special  materials; 
can  detect  surface  flaws 
only;  a development  process 
precedes  output  information. 

Surfaces  of  materials  and 
items  not  damaged  by  the 
process;  nonporous 
materials.' 

Ultra- 

sonics 

Penetrates  deep;  can  detect 
flaw  with  access  to  only  one 
side  of  material;  sensitive. 

Requires  a specially  skilled 
operator;  permanent  records 
and  readout  difficulty. 

Bonded  structures  and 
materials;  all  solids. 

Will  Detect 


A wide  range  of 
surface  flaws; 
visible  damage, 
etc. 

Flaws  in  totally 
enclosed  compo- 
nents, machinery, 
etc.;  defects  in  fast 
moving  equipment. 

Small  temperature 
gradients  on  sur- 
face. 


Flaws  and  anom- 
alies on  surface 
or  within  magnetic 
materials. 

Surface  aacks, 
flaws,  and  defects. 


Disbonds,  defects, 
CTacks,  and  flaws. 


IR  = infrared 


oo 
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Figure  8-1.  Basic  Arrangements  of  Radiographic  Measurement  Components' 


Electron  radiation  is  generated  by  electron 
accelerating  tubes  (electron  guns)  and  by  X 
or  gamma  rays  entering  a material.  Electron 
beam  radiation  is  used  with  electron  micro- 
scopes to  map  subsurface  phenomena.  Reso- 
lutions in  the  submicrometer  region  have 
been  achieved.  Electron  radiography  also 


makes  use  of  the  source-detector-material 
arrangement  shown  in  Fig.  8-1  (B).  An  advant- 
age of  this  method  is  that  access  is  required 
to  only  one  side  of  the  material.  Electron 
radiation  also  can  be  transmitted  through 
the  material  to  measure  material  density  and 
thickness. 


TABLE  8-3 

CHARACTERISTICS  OF  RADIOGRAPHIC  NDE  METHODS' 


Radiation  Source  Material  (Applications)  Detector 


X Rays 

Conventional  X-ray 
equipment 

Locating  foreign  objects, 
flaws,  and  anomalies 
in  parts  and  materials; 
observing  machinery 
in  operation. 

X-ray  sensitive  films; 
color  radiographic 
films;  Polaroid  process; 
Xeroradiography; 
fluoroscopy. 

Electrons 

(Beta 

Particles) 

Electron  guns;  sec- 
ondary electrons 
emitted  when  X rays 
enter  sample;  radio- 
isotopes. 

Density  measurements; 
thickness  measurements 
surface  phenomena 
detection  not  dis- 
tinguishable under 
visible  light. 

Photographic  films; 
electrical  detectors. 

Neutrons 

Fission  reactors 
and  special  neu- 
tron sources. 

Used  in  lieu  of  X rays 
for  heavy  materials;  for 
use  with  materials 
which  absorb  X rays  but 
not  neutrons. 

Photographic  film 
sensitive  to  neutrons; 
neutron  detectors. 

Protons 

Accelerators 

Thickness  and  density 
measurements. 

Proton  detector. 

Gamma  Rays 

Radioisotopes 

Used  in  same  manner 
as  X rays. 

Photographic  films; 
gamma  detectors. 

Alpha 

Particles 

Radioisotopes 

Thickness  measurements 
of  very  thin  materials. 

Alpha  detectors  with 
electrical  readout. 
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Neutrons  are  absorbed  differently  by  dif- 
ferent materials  (nuclei).  These  differences 
sometimes  can  be  exploited  for  better  flaw 
discrimination.  Most  hea\’y  materials  do  not 
absorb  neutrons  well,  so  that  thick  sections 
can  be  investigated  with  shorter  exposure 
times.  Neutrons  can  be  used  to  examine 
materials  (such  as  many  plastics)  which  con- 
tain hydrogen.  A disadvantage  is  that 
neutrons  are  difficult  to  record  on  film,  and 
a special  process  is  required  for  detection. 

Alpha  and  beta  particles  are  both  used  for 
thickness  measuring.  By  using  a wide  range 
of  energies,  thickness  measurements  using 
beta  sources  can  be  made  from  15  pin.  of 
aluminum  to  0.050  in.  of  steel.  Alpha 
particles  have  been  used  to  measure  1%  thick- 
ness changes  in  thin  foils  and  paper  (Ref  2). 

Radiography  is  probably  the  most  widely 
used  NDE  method.  Equipment  for  these 
tests  is  readily  available.  The  topic  is 
thoroughly  described  in  Ref  3. 

8-4  THERMAL  METHODS 

The  flow  of  heat  through  a material  is 
altered  by  discontinuities  in  the  material. 
These  discontinuities  produce  variations  in 
temperature  at  the  surface  of  the  item.  The 
location  and  size  of  an  anomaly  can  be  de- 
termined by  the  temperature  profile  at  the 
surface.  Thermal  methods  are  useful  for 
evaluating  bonds  between  tw  o materials. 

The  heat  can  be  applied  artificially  or  may 
be  generated  by  the  operation  of  the  item. 
For  example,  engine  cylinders  can  be  uni- 
formly heated  by  being  filled  with  hot  oil. 

An  operating  microcircuit  produces  heat 
internally.  Many  methods  of  detecting  and 
recording  the  surface  temperature  gradients 
are  available.  Table  8-4  outlines  the  char- 
acteristics of  these  techniques. 

The  “frost”  test  can  be  used  for  testing  the 
bond  quality  of  clad  nuclear  fuel  elements. 


A chemical  that  has  a frosty  appearance 
and  a known  melting  temperature  is  applied 
to  the  element  and  heat  applied.  A poor 
bond  causes  a change  in  appearance.  The 
method  can  be  used  on  other  materials. 

The  temperature  profile  of  a surface  can 
be  sensed  by  a coating  of  a phosphor  sus- 
pended in  a liquid.  The  reaction  of  the 
phosphor  to  ultraviolet  light  changes  as  a 
function  of  temperature. 

Tempilstiks®  are  crayons  made  of  a 
material  that  melts  at  a calibrated  temper- 
ature. A specimen  is  marked  with  the  appro- 
priate Tempilstik®  before  heat  is  applied. 

The  mark  melts  at  its  calibrated  temperature. 
Other  similar  Tempil  products,  such  as 
Tempilaq®  and  temperatuie  sensitive  pel- 
lets, are  available  commercially. 

Temperature-sensitive  paints  (Thermo- 
eolor.  Ref  3)  whieh  change  color  as  a 
function  of  temperature  also  can  be  used. 
Some  of  these  paints  ehange  color  as  often 
as  four  times  at  four  different  temperature 
levels.  The  ehanges  are  permanent  and  pro- 
vide a good  permanent  reeord.  These  paints 
ean  be  used  on  almost  any  surfaee  over  a 
range  of  104°  to  2912°F  and  are  aceurate 
within  ±9  deg  F.  The  paint  must  dry  for  30 
min  before  use  and  must  be  removed  after 
use.  The  surface  to  which  it  is  applied 
must  be  thoroughly  clean  before  applica- 
tion. 

Infrared  photography  and  photomicro- 
graphy can  be  used  to  record  temperature 
profiles  of  surfaces.  A newer  and  more 
sophisticated  method  is  infrared  scanning. 
Flere,  the  surface  of  the  specimen  is  scanned 
by  an  optical-mechanical  system  which 
focuses  small  portions  of  the  surface  onto 
a IR  detector  (Ref  4).  This  technique  can 
be  used  to  determine  the  temperature  pro- 
file of  microcircuits.  Temperature  differ- 
ences as  low  as  0.5  deg  C can  be  resolved, 
and  components  separated  by  as  little  as 
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00 

dh 


CHARACTERISTICS  OF  THERMAL  METHODS' 


Method 

Application 

Detector 

Detector  Applied  by 

Capabilities 

Disadvantaaes 

Frost  Test 

Cladding  bond  qual- 
ity of  nuclear  fuel 
elements  and  other 
bonds. 

Acenaphthene  or 
Diphenyl. 

Brush  or  spray. 

Can  locate flawswith 
dimensions  0.1 
in.^  X 0.2  in. 

An  important  flaw  can 
have  low  thermal 
resistance  and  go  un- 
detected. 

Temperature 

Sensitive 

Phosphor 

Evaluating  metal -to- 
metal  bonds,  fusion 
bonds,  etc. 

Zinc-cadmium  sulfide 
phosphor  In  a plastic 
suspension  viewed 
under  ultraviolet 
light. 

Brush  or  spray. 

Changes  emission 
by  20% when  tem- 
perature changes  2% 
over  range  of  40"  to 
130°F. 

Must  be  viewed  under 
ultraviolet;  emission 
change  is  reversible. 

Tempilstik® 

Almost  any  surface. 

T emperature  sensi- 
tive crayons  having 
calibrated  melting 
points. 

Marking  or  touching. 

Indicates  a temper- 
ature within  toler- 
ance of  ± 1%  over  a 
range  of  11 3" to 
2000"  F. 

Indicates  only  one 
temperature  per 
application;  will  not 
work  at  higher  tem- 
peratures in  a re- 
ducing environment. 

Temperature 

Sensitive 

Paints 

Almost  any  surface, 
e.g.,  metals,  ce- 
ramics, stone,  por- 
celain, plastics, 
wood,  and  glass. 

Paint  changes  color 
with  temperature- 
change;  is  permanent. 

Brush  or  spray. 

104"to2912°F  with- 
in ± 9 deg  F;  can  lo- 
cate flaws  on  order  of 
0.001  in. 

Must  dry  30  min 
before  use. 

Infrared 

Any  surface  emitting 
IR  radiation,  i.e., 
heated  surface. 

Photographic  film 
and  IR  detector. 

No  contact;  IR 
applied  to  detector 
or  films  by  optical  lens 
system. 

Can  detect  temper- 
ature differences  as 
low  as  0.5  deg  C;has 
a resolution  as  small 
as  0.0014  in. 

The  more  sensitive 
methods  require 
expensive  equipment. 

Temperature 

Probes 

T emperature  measure- 
ments of  surfaces 
and  bulk  of  most 
materials. 

Thermometers,  therm- 
istors, thermocou- 
ples, and  resistance 
thermometers. 

Contact  to  material 
or  medium  to  be 
measured. 

Can  measure  temper- 
atures between  ap- 
proximately -200° 
to  -r2000°C  within 
± 1%. 

Has  low  resolution 
for  temperature 
profiling;  lead 
wires  conduct  heat 
away  from  surfaces. 

etc.,  reducing  true 
temperature. 


IR  = infrared. 
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0.0014  in.  can  be  distinguished.  The  method 
has  been  used  to  determine  bond  quality  in 
large  objects  such  as  solid-fuel  rocket  motor 
cases  (Ref.  5).  A practical  application  of  the 
IR  technique  is  discussed  in  Ref  6.  The 
big  disadvantage  is  that  the  emissivity  of  the 
surface  must  be  constant. 

IR  photographic  equipment  can  be  ob- 
tained from  many  photographic  equipment 
manufacturers.  A sensitive  solid-state  IR  de- 
tector also  has  been  developed. 

Temperature  probes  can  be  used  as 
temperature  profile  gages.  These  probes  use 
conventional  thermometers,  thennistors,  re- 
sistance thermometers,  and  thermocouples 
as  the  temperature  sensing  elements.  These 
devices  measure  temperature  accurately,  eon- 
veniently,  and  economically;  however,  large 
numbers  of  them  are  required  to  profile  a 
surface  without  reducing  resolution.  Also, 
the  devices  themselves,  and  associated  lead 
wires,  etc.,  tend  to  lower  the  temperature  to 
be  measured.  Therefore,  the  temperatures 
recorded  with  these  devices  are  somewhat 
lower  than  these  recorded  by  no-contact  tech- 
niques such  as  IR  scanning. 

8-5  LIQUID  PENETRANTS 

Liquid  penetrants  can  be  used  to  deteet 
surface  flaws  in  most  materials.  Surfaee  flaws 
are  open  to  the  surface  but  are  not  readily 
detectable  by  visual  means.  Few  flaws  are 
revealed  by  penetrant  inspection  which  could 
not  be  seen  visually,  but  penetrants  make  the 
defects  much  easier  to  locate.  Penetrants  ean 
be  used  with  metals,  glazed  ceramics,  plastics, 
and  nonporous  materials.  Specialized  pene- 
trants are  available  for  porous  materials. 

Flaws  are  located  by  covering  the  surfaee  of 
the  material  with  a liquid  having  a low  sur- 
face tension  and  a low  viscosity.  The  liquid 
is  drawn  into  the  surface  defects  by  capil- 
lary action.  After  the  excess  penetrant  is 
removed  from  the  surface,  a developer  is 


applied  which  makes  the  penetrant  and  the 
flaw  visible. 

There  are  two  basic  types  of  penetrants: 
dye  penetrants  and  fluorescent  penetrants. 

Dve  penetrants  consist  of  a dye  dissolved  in 
the  liquid  penetrant.  The  color  of  the  dye  is 
chosen  to  give  greatest  contrast  with  the 
developer.  One  particular  dye  penetrant  pro- 
vides a red-on-white  record  of  defects  which 
can  be  removed  from  the  material  as  a 
permanent  record. 

Fluorescent  penetrants  consist  of  a fluores- 
cent phosphor  dissolved  in  the  liquid  pene- 
trant. This  type  of  penetrant  works  in  the 
same  manner  as  other  penetrants.  However, 
flaws  must  be  viewed  under  near-ultraviolet 
light  nanometers). 

Some  precautions  must  be  taken  while 
using  these  materials: 

1.  The  surface  of  the  specimen  must  be 
thoroughly  cleaned  before  the  penetrant  is 
applied. 

2.  Sufficient  time  must  be  allowed  for  the 
penetrant  to  penetrate  the  flaw. 

5.  The  excess  penetrant  must  be  removed 
with  care. 

4.  The  developer  must  be  applied  in  a 
speeified  temperature  range. 

Two  speeial  penetrant  teehniques  use  radio- 
aetive  penetrants  and  filtered  partieles.  The 
radioactive  method  uses  a radioactive  pene- 
trant and  detects  the  amount  of  this  pene- 
trant trapped  in  defeets  by  either  a photo- 
graphic method  or  with  a radiation  detector. 
This  technique  is  used  primarily  to  determine 
the  porosity  in  metal  alloys.  The  filtered 
particle  method  is  used  to  detect  flaws  in 
porous  surfaces  sueh  as  concrete  or  carbon. 
The  penetrant,  in  this  case,  contains  sus- 
pended particles.  The  liquid  is  absorbed  by 
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Figure  8-2.  Effect  of  Flow  of  Magnetic  Flux  Lines’ 


the  defect,  but  the  particles  are  larger  than 
the  defect  and  are  filtered  out  and  left  be- 
hind on  the  surface.  These  particles  then  give 
an  indication  of  a flaw.  Fluorescent  particles 
can  be  used  to  provide  more  contrast. 

Liquid  penetrant  inspection  is  covered  in 
detail  in  Refs.  3 and  7. 


8-6  MAGNETICS 

This  method  is  based  on  the  fact  that 
flaws  in  a magnetic  material  have  magnetic 
properties  different  from  those  of  the 
material  itself  Once  a magnetic  field  is  in- 
duced in  a material,  any  flaw  will  perturb  or 
distort  the  field  because  the  flaw  has  a differ- 
ent magnetic  permeability  and,  thus,  a differ- 
ent reluctance,  than  the  material.  The  flaw  is 
located  by  measuring  these  perturbations. 

Fig.  8-2  shows  how  flaws  affect  magnetic  flux 
lines. 

A magnetic  field  can  be  set  up  in  a magnetic 
material  by: 

1 . Passing  a current  through  all  or  a portion 
of  the  specimen 

2.  Passing  a current  through  a coil  sur- 
rounding or  in  contact  with  the  specimen 

3.  Permanent  magnets. 


The  method  depends  on  the  type  of  flux 
lines  desired.  Passing  a current  through  a 
specimen  generates  circular  flux  lines  around 
the  current  path.  A coil  around  a specimen 
and  magnets  produce  longitudinal  magneti- 
zation. Both  types  of  flux  lines  may  be 
needed  because  the  extent  to  which  a flaw 
perturbs  flux  lines  depends  on  its  orientation 
with  respect  to  the  direction  of  the  lines. 

For  example,  a crack  perpendicular  to  flux 
lines  perturbs  them  whereas  a crack  parallel 
to  the  lines  may  not.  Thus,  both  flux 
orientations  may  be  necessary  to  detect  all 
flaws  in  a material. 

Several  methods  can  be  used  to  detect  the 
perturbations  caused  by  flaws  and  defects. 

The  simplest  is  to  pass  a compass  over  the 
magnetized  surface.  The  compass  needle 
will  align  with  the  overall  field  except  in  the 
vicinity  of  a flaw.  Although  this  method  is 
crude  and  insensitive,  the  same  principle  gives 
good  results  when  extended  to  distributing 
iron  filings  - either  dry  or  in  a liquid  sus- 
pension — over  the  surface  of  interest.  These 
filings  sometimes  are  coated  with  a fluorescent 
material  that  produces  a more  visible  pattern. 
The  filings  line  up  with  the  induced  magnetic 
field,  except  in  the  area  of  flaws  or  discontinu- 
ities in  the  material.  Another  detection 
method  is  to  pass  a current-carrying  search 
coil  over  the  surface.  When  the  coil  moves 
through  a perturbation,  a voltage  is  generated 
between  the  coil  and  the  inspected  material. 
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The  magnitude  of  the  voltage  gives  an  indica- 
tion of  the  size  of  the  flaw.  This  method  is 
very  useful  when  the  entire  object  to  be  in- 
spected (pipes,  wire,  etc.)  can  be  passed 
through  a coil.  A third  method  takes  advant- 
age of  the  Hall  effect.  Hall  effect  probes 
usually  are  made  of  a semiconductor  material 
and  are  passed  over  the  surface  of  the  mag- 
netized specimen.  Variations  in  the  magnetic 
field  due  to  defects  and  discontinuities  result 
in  a variation  in  the  Hall  voltage  of  the  probe. 

The  sensitivity  of  this  method  depends  on 
the  strength  of  the  magnetic  field.  Defects  of 
any  consequence  can  usually  be  detected 
down  to  0.060  in.  below  the  surface.  Defects 
down  to  0.100  in.  deep  will  show  under  ideal 
conditions  (Ref.  1).  A number  of  other 
factors  such  as  sharpness,  direction,  and 
orientation  of  the  defects  also  affect  the  sensi- 
tivity of  the  method. 

Eddy  current  testing  is  based  on  the  princi- 
ple that  when  a coil  carrying  a high  frequency 
alternating  current  is  brought  into  the  vieinity 
of  an  electrical  conductor,  currents  are  in- 
duced. These  currents,  in  turn,  induce  a 
magnetic  field  about  the  conductor.  The  in- 
duced currents  and  the  magnetic  field  are  af- 
fected by  the  permeability  of  the  material. 
Eddy  currents  can  be  used  to  test  and  measure 
hardness,  alloy  content,  uniformity  of  heat 
treatment,  as  well  as  for  flaw  detection. 

Flaws  perturb  and  distort  the  magnetic  field 
produced  by  the  eddy  currents. 

Two  general  types  of  probes  are  used  in 
eddy  current  testing.  One  is  an  encircling 
coil  which  surrounds  the  specimen  and  in- 
vestigates everything  within  the  coil  geometry. 
The  other  is  a point  probe  which  inspects 
only  the  area  beneath  it. 

The  coil  type  detector  is  affected  by  all 
the  metal  enclosed  by  the  coil,  so  statements 
about  sensitivity  are  difficult  to  make,  e.g., 
a long  shallow  crack  may  give  the  same  output 
as  a short  deep  one.  At  maximum  resolution. 


a defect  whose  length  is  comparable  to  the 
coil  length  (roughly  0.1  in.  minimum)  and 
whose  depth  is  5%  or  more  of  material  wall 
thickness  can  be  detected.  The  probes  are 
also  sensitive  to  the  displaced  volume  of 
metal  and  are  sensitive  to  defects  on  the  order 
of  the  probe  diameter.  One  such  probe,  the 
Probolog,  developed  by  Shell  Development 
Company,  can  detect  cracks  or  seams  0.005  in. 
deep  by  0.5  in.  long.  The  probe  also  can  de- 
tect 1%  thickness  changes  in  a 0.5  in.  length. 

8-7  ULTRASONICS 

Ultrasonic  waves  are  acoustic  waves  above 
the  audible  range.  They  are  employed  in 
NDE  to  detect  and  locate  flaws  in  composite 
materials  and  nonbonded  areas  in  bonded 
materials.  The  impedance  to  ultrasonic 
propagation  is  different  for  a flaw  or  anomaly 
than  for  the  basic  material.  Therefore,  a 
portion  of  the  induced  ultrasonic  energy  is 
reflected  by  a flaw,  just  as  it  is  by  a boundary 
of  the  material.  Measurement  of  the  re- 
fleeted portion  or  the  unreflected  portion  is 
the  basis  for  employing  ultrasonics  in  NDE. 

There  are  three  methods  of  ultrasonic 
testing  in  general  use:  pulse  echo,  trans- 
mission, and  resonance. 

8-7.1  PULSE  ECHO  METHOD 

In  the  pulse  echo  method,  an  applied 
pulse  travels  through  the  material  and  is  re- 
flected from  flaws  and  material  boundaries. 

As  the  surface  of  the  material  is  scanned, 
the  appearance  of  a “defect  pulse”  locates 
the  surface  position  of  a flaw.  The  energy  of 
this  pulse  is  related  to  flaw  size,  but  is 
usually  difficult  to  correlate  precisely.  By 
monitoring  the  time  relationship  of  the  initial 
pulse,  the  “defect  pulse”,  and  the  echo  pulse, 
the  defect  can  be  located  in  depth.  Many 
techniques  have  been  used  in  the  pulse  echo 
method.  For  example,  by  introducing  the 
initial  pulse  at  an  angle  to  the  material 
surface,  the  boundary  reflection  can  be 
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effectively  removed  in  the  return.  Also,  flaws 
that  are  not  accessible  by  a simple  geometry 
can  be  detected  by  letting  the  pulse  zig-zag 
from  one  boundary  to  another  until  a flaw  is 
reached.  Thus,  rather  complex  geometries 
can  be  probed  by  this  method. 


8-7.2  TRANSMISSION  METHOD 

The  transmission  method  is  very  similar 
to  the  pulse  echo  technique.  A pulse  is  in- 
troduced at  one  boundary  of  a material  and 
sensed  at  another.  The  energy  transmitted 
past  the  flaw  is  attenuated  due  to  reflection. 
The  energy  received  is,  therefore,  less  when 
a flaw  is  present  than  when  there  is  no  flaw. 
This  energy  decrease  indicates  the  surface 
position  of  a flaw,  but  gives  no  measure  of 
depth. 

8-7.3  RESONANCE  METHOD 

In  the  resonance  method,  a material  is 
excited  at  its  thickness  resonant  frequency. 

The  material  is  driven  by  a transducer  which 
is,  in  turn,  controlled  by  a variable  frequency 
oscillator.  When  the  resonant  frequency  is 
reached,  a standing  wave  will  be  established 
between  the  material  faces.  As  the  surface 
of  the  material  is  scanned,  any  change  in  reso- 
nant frequency  not  associated  with  material 
thickness  indicates  a flaw.  This  method  is 
used  for  thickness  measurement  as  well  as  for 
flaw  detection.  Both  longitudinal  and  trans- 
verse ultrasonic  waves  are  used.  Special  prop- 
agation modes  called  Rayleigh  waves  and  Lamb 
waves  are  less  frequently  used. 

Rayleigh  waves  are  surface  waves  analogous 
to  ripples  on  water  and  can  be  generated  by 
controlling  the  angle  of  incidence  of  the  input 
ultrasonic  energy.  The  Rayleigh  wave  tech- 
nique is  useful  for  scanning  across  the  surface 
of  an  item  for  flaws  near  the  surface.  A dis- 
tinct advantage  of  this  method  is  its  useful- 
ness in  investigating  curved  surfaces. 


Lamb  waves  are  elastic  vibrations  analogous 
to  ripples  in  the  whole  material.  These  waves 
have  proven  useful  in  detecting  nonbonded 
areas  in  laminated  structures  where  vibration 
in  localized  areas  induced  by  the  Lamb  waves 
can  be  sensed.  The  Lamb  wave  technique  is 
capable  of  detecting  cracks  that  extend  as 
little  as  0.001  in.  below  the  surface  of  a 
material. 

8-7.4  ADVANTAGES  AND  DISADVAN- 
TAGES 

One  of  the  major  advantages  of  ultrasonic 
test  techniques  is  their  ability  to  penetrate 
into  a material  to  locate  flaws.  This  depends 
on  available  power  and  sensitivity  of  the 
detection  equipment;  however,  the  technique 
has  been  used  to  locate  flaws  as  deep  as  30 
ft  down  in  a metallic  bar.  It  also  permits 
rapid  measurements  and  is  economical, 
relatively  sensitive,  and  reasonably  accurate 
for  measuring  flaw  extent  and  position.  Ac- 
cessibility to  a single  surface  is  adequate  for 
detecting  many  flaws  and  anomalies. 

The  resolution  of  ultrasonic  test  methods 
depends  on  the  frequency  of  the  ultrasonic 
propagation.  The  higher  the  frequency,  the 
smaller  the  defect  that  can  be  resolved.  A 
limiting  factor  is  that  absorption  of  ultrasonic 
energy  increases  with  increasing  frequency. 
Therefore,  a trade-off  between  frequency  and 
available  energy  must  be  made.  Generally 
available  equipment  permits  detection  of  flaws 
with  dimensions  in  the  0.001  to  0.005  in. 
range. 

The  inconvenience  of  getting  ultrasonic 
energy  into  and  detecting  the  energy  from  a 
specimen  is  one  of  the  major  disadvantages  of 
ultrasonic  methods.  Air  does  not  provide  the 
proper  impedance  match  between  the  trans- 
ducer and  specimen,  so  that  liquid  couplants 
such  as  oil,  water,  or  glycerine  are  required. 
Another  major  disadvantage  is  in  readout  of 
the  information.  Display  of  pulse  positions  on 
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a CRT  often  is  used.  Two-dimensional  scan- 
ning and  imaging  is  being  employed  to  a 
limited  extent  but  requires  further  development 
to  become  a practical  tool.  Major  drawbacks 
of  the  imaging  techniques  are  distortion  and 
limitations  on  resolution.  Another  disadvan- 


tage is  that  highly  skilled  operators  are  required. 
Specimen  geometry  limits  the  size,  contour, 
and  complexity  of  shapes  that  can  be  tested. 
Misleading  responses  may  be  obtained  from 
usual  internal  structural  characteristics  such  as 
large  grains  or  porosity. 
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CHAPTER  9 
TEST  EQUIPMENT 


9-1  INTRODUCTION 

The  success  or  failure  of  a test  program 
often  depends  on  how  the  test  equipment  is 
selected,  designed,  procured,  and  tested. 

The  test  equipment  determines  the  accuracy 
of  the  measurements,  the  repeatability  and 
usability  of  the  results,  and  the  cost  of  the 
test  program;  and  these  factors  in  combin- 
ation frequently  determine  whether  or  not 
the  test  program  is  worthwhile.  It  is  very 
important  that  great  care  be  taken  in 
choosing  the  test  equipment.  Since  test 
equipment  is  frequently  more  complex  than 
the  hardware  being  tested,  the  design  of 
the  special  equipment  should  be  given  to 
experienced  engineers. 

A test  equipment  program  should  receive 
the  same  level  of  management  consideration 
as  the  design  and  production  of  the  hard- 
ware. Often,  more  management  attention 
is  required  on  the  scheduling  aspects  of  the 
test  equipment  program  than  on  any  other 
part  of  the  program  because  of  the  com- 
plex nature  of  the  equipment.  On  complex 
programs,  a test  equipment  coordinating 
committee,  which  functions  from  the  earli- 
est phase  of  the  project  until  production  is 
firmly  established  with  proofed  and  ap- 
proved test  equipment,  should  be  appointed. 
This  committee  may  be  required  to  super- 
vise the  design  and  development  of  new 
and  unique  test  equipments,  to  delineate 
design  requirements  which  ensure  com- 
patibility of  test  equipments  and  hardware, 
and  to  establish  schedules. 

Test  equipment  includes  the  equipment 
providing  inputs  to  the  hardware  being 


tested,  the  measurement  equipment  de- 
tecting the  output,  and  the  equipment  pro- 
viding the  environment  to  which  the  hard- 
ware is  exposed  during  the  test. 

Ref  2 is  a good  source  of  material  on 
this  topic. 

9-2  COMPARATIVE  FEATURES 

It  is  convenient  to  consider  several 
features  of  test  equipment  separately, 
namely:  purpose,  type  of  control.  Cali- 
bration, and  readout. 

Test  equipment  can  be  classified  as 
either  general  or  special  purpose,  depending 
upon  whether  the  equipment  is  usable  on 
one  or  more  than  one  type  of  test  article. 
General  purpose  test  equipment  should  be 
used  whenever  possible,  unless  some  feature 
of  the  test  program  mandates  the  use  of 
special  purpose  equipment.  Among  the 
factors  which  may  dictate  special  pur- 
pose equipment  are: 


1.  No  general  purpose  equipment  is  com- 
mercially available  to  make  the  test. 

2.  General  purpose  equipment  error 
is  too  large  and  consumes  too  much  of 
the  product  tolerance. 

3.  General  purpose  equipment  set-up 
time  is  too  long,  considering  the  frequency 
with  which  the  proposed  test  will  be  per- 
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formed,  and  the  general  purpose  equip- 
ment use  factor  is  too  high  to  permit  tying 
it  up  in  a permanent  set-up. 

4.  Test  time  with  general  purpose 
equipment  is  excessive,  and  the  frequency 
of  the  test  performance  is  high  enough  to 
warrant  the  cost  of  designing  and  building 
special  equipment. 

Usually,  general  purpose  equipment  pro- 
vides greater  flexibility  than  special  pur-  , 
pose  equipment,  but  at  a reduced  testing 
efficiency.  In  large  projects  the  sheer 
numbers  of  instruments  and  test  equip- 
ments that  must  be  used  make  it  possible 
to  choose  special  test  equipment  whenever 
the  economics  of  a particular  test  dictate, 
since  the  large  pool  of  standard  equipment 
usually  available  provides  all  the  flexibility 
required.  In  small  laboratories,  problems 
arise  because  the  supply  of  standard  equip- 
ment is  limited.  It  is  frequently  (though 
not  always  wisely)  decided  to  use  standard 
equipment,  which  is  more  costly  than 
special  test  equipment,  in  order  to  force  the 
purchase  of  additional  standard  equipment. 

Test  equipment  also  can  be  classified 
according  to  the  way  in  which  it  is  con- 
trolled or  programmed,  either  manually 
or  automatically.  As  a general  rule,  initial 
and  maintenance  costs  of  manual  control 
are  lower,  but  it  is  more  expensive  to  op- 
erate because  manual  control  requires  con- 
stant operator  attention.  In  most  repeti- 
tive testing,  the  additional  costs  of  auto- 
mation can  be  recovered  if  the  testing  con- 
tinues for  a sufficient  length  of  time.  An- 
other important  saving  provided  by  auto- 
matic testing  results  from  the  elimination 
of  operator  error.  Automated  test  equip- 
ment usually  provides  more  repeatable  re- 
sults, permitting  easier  understanding  and 
diagnosis  of  test  failures  or  anomalies  (which 
represents  additional  cost  savings),  more- 
uniform  testing,  and  more-consistent  quality 
of  product.  Therefore,  for  repetitive  test- 


ing, the  use  of  automated  test  equipment 
should  be  considered.  Substantial  savings 
often  can  be  realized  from  the  automation 
of  cyclic  vibration  testing. 

The  form  of  the  output  from  automated 
tests  should  be  compatible  with  the  existing 
computer  facilities  in  the  plant  to  permit 
rapid  data  analysis  or  a Separate  minicom- 
puter should  be  used.  Equipment  to  pro- 
vide almost  any  kind  of  output  is  com- 
mercially available.  A printed  or  visual  dis- 
play can  provide  an  immediate  record  of 
results  for  on-the-spot  analysis.  This  equip- 
ment also  can  show  the  accept/reject  limits 
simultaneously  with. the  observed  values, 
and  can  be  programmed  to  identify  an  out- 
of-tolerance  condition. 

With  automatic  test  equipment,  the  soft- 
ware can  be  extremely  expensive.  Up-to- 
date  knowledge  of  computer  trade-offs  is 
needed,  and  computer  programmers  will  be 
a vital  part  of  the  project.  Flexibility  in 
allowing  the  program  to  change  with  needs 
should  be  considered  as  important  as  the 
initial  program. 

9-3  STANDARDIZATION  OF  TEST 
EQUIPMENT 

When  the  product  is  tested  for  the  same 
attributes  as  it  passes  from  vendor  to  pur- 
chaser or  user;  or  when  it  is  tested  in 
several  different  locations  or  at  multiple 
field-assembly  sites;  or  when  the  same  tests 
are  used  for  acceptance  testing,  field  evalu- 
ation testing,  and  repair-depot  testing,  each 
at  a different  location;  then,  the  test  results 
must  be  compatible.  In  these  situations,  the 
testing  and  test  conditions  must  be  as  iden- 
tical as  possible  to  prevent  testing  errors  and 
differences  from  different  test  locations  from 
affecting  the  results. 

The  errors  and  differences  introduced  by 
test  equipment  at  different  locations  can  be 
important.  The  test  equipment  should  be 
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identical  at  all  locations.  If  this  is  impossible, 
the  differences  should  be  held  to  an  absolute 
minimum  and  should  be  known  and  evalu- 
ated carefully  to  determine  the  exact  quanti- 
tative differences.  There  are  several  potential 
sources  of  error.  The  most  important  are 
those  introduced  by  the  use  of  supposedly 
identical  or  interchangeable  equipments  which 
are  not  really  identical  or  interchangeable. 

This  problem  can  be  minimized  by  assigning 
the  design  of  the  test  equipment  to  a single 
group  and  by  instructing  the  design  group  to 
use  the  same  testing  techniques  and  circuits 
throughout  the  project.  The  uniformity  of 
purchased  test  equipment  is  more  difficult 
to  control,  since  competitive  procurement 
procedures  lead  to  pressures  to  accept  ap- 
parently or  allegedly  alternate  and  inter- 
changeable instruments  without  complete 
comparative  evaluation  or  analysis.  Test 
personnel  must  constantly  resist  this  pres- 
sure - the  world  is  rarely  as  advertised  and 
the  difficulties  can  be  very  subtle  and  in- 
sidious. 

9-4  TEST  EQUIPMENT  ERROR 

All  measuring  equipment  has  an  inherent 
error.  The  amount  of  the  error  is  frequently 
an  important  portion  of  the  allowable  or 
desired  tolerance  on  the  parameter  being 
tested,  so  that  considerable  degradation  of 
the  product  can  result  from  ignoring  test 
equipment  error.  Test  equipment  error  exists 
not  only  in  the  reading  or  sensing  portion  of 
the  test  equipment,  but  in  the  portions  pro- 
viding the  inputs  and  environmental  con- 
ditions as  well. 

The  total  error  always  should  be  measured 
for  complex  special  test  equipment.  The 
measurement  is  best  made  at  the  interface 
between  the  test  leads  and  the  article  to  be 
tested  (where  it  will  include  the  error  of  the 
cabling  and  connectors),  with  the  equipment 
and  the  article  both  energized  and  operating. 
Theoretically-computed  errors  can  be  use- 
ful during  the  test  equipment  design  phase. 


but  actual  measurements  should  be  made  to 
verify  the  calculations  before  the  test 
equipment  is  released  for  use.  In  such  cal- 
culations, provided  they  are  verified,  it  is 
generally  permissible  to  use  statistical  tech- 
niques to  combine  the  individual  errors  in- 
troduced by  the  many  elements  of  the  test 
equipment. 

9-5  TEST  EQUIPMENT  CALIBRATION 

Automation  in  complex  weapon  systems 
has  tremendously  increased  the  importance 
of  calibrated  test  equipment.  Because  of  the 
increased  number  and  dispersal  of  the  sup- 
pliers, manufacturers,  and  field  activities  that 
test  all  or  part  of  these  systems,  test  engine- 
ers must  give  consistent  and  compatible  re- 
sults. 

Another  major  source  of  test  errors  is  a 
poor  calibration  system  which  is  not  rigor- 
ously traceable  to  the  standards  of  measure- 
ment held  by  the  National  Bureau  of  Stan- 
dards (NBS). 

Test  equipment  incompatibilities  can 
result  in  major  catastrophic  failures. 

Calibration  is  defined  as  the  comparison 
of  the  indication  of  a measuring  device  with 
a known  standard,  the  known  standard  it- 
self being  calibrated  against  more  accurate 
standards  in  a series  of  rigorously  controlled 
echelons  up  to  a national  standard  held  by 
the  NBS.  All  test  and  measuring  equipment 
used  in  high-reliability  projects,  including 
those  used  by  R&D  personnel,  must  be  Cah- 
brated  against  laboratory  standards  at  speci- 
fied interv'als.  These  intervals  should  be  set 
after  thorough  analysis  of  drift  rates  or  sus- 
ceptibility of  instruments  to  inaccuracies 
from  handling. 

A system  of  mandatory  recall  usually  is 
required  to  ensure  satisfactory  operation  of 
a calibration  program,  since  most  test  op- 
erators are  slow  to  release  instruments  for 
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calibration.  Mandatory  recall  means  that  the 
calibration  laboratory  is  directed  by  projeet 
management  to  remove  physically  an  in- 
strument, when  due,  from  the  test  floor  to 
the  laboratory  for  calibration.  To  make  sueh 
an  operation  practical,  a loan  pool  of  cali- 
brated instruments  must  be  available  for  re- 
placement of  instruments  removed. 

Most  large  industrial  firms  and  Government 
activities  have  their  own  ealibration  labor- 
atories. Project  test  personnel  must  ensure 
that  the  laboratory  is  advised  early  in  the 
project  of  any  new  (or  more  difficult)  mea- 
surement requirements,  so  that  additional 
standards  ean  be  proeured  and  calibration 
procedures  prepared  and  proofed  out  in  time 
to  support  these  new  measurements. 

In  smaller  companies  and  activities,  how- 
ever, ealibration  laboratories  are  not  usually 
economically  feasible.  These  activities  must 
use  the  services  of  commercial  calibration 
laboratories.  They  should  do  so  with  great 
care,  however,  because  many  commercial 
companies  do  not  have  adequate  calibration 
facilities.  When  no  suitable  commercial 
calibration  laboratory  is  available  in  a local 
area,  arrangements  should  be  made  with  the 
nearest  Department  of  Defense  industrial 
facility  to  perform  instrument  (or  stan- 
dards) calibration. 

The  Standards  Laboratory  Information 
Manual,  published  by  the  Department  of  the 
Navy,  Bureau  of  Naval  Weapons,  Pomona, 
California,  presents  a complete  treatise  on 
calibration  and  standards  laboratories  (Ref. 

1).  This  manual  includes  recommended 
recalibration  frequencies  for  a large  list  of 
commercial  measuring  equipment.  Three 
basic  kinds  of  calibration  are  discussed:  (1) 
calibration  of  individual  instruments,  sueh  as 
meters,  gages,  and  power  supplies;  (2)  cali- 
bration of  systems  of  complex  test  or  en- 
vironmental equipment;  and  (3)  calibration 
of  standards. 


Individual  instruments  usually  are  trans- 
ported to  a calibration  laboratory  for  cali- 
bration at  intervals  ranging  from  one  to  three 
months.  A sticker  must  be  applied  to  the 
instrument  to  indicate  the  date  calibrated  and 
the  date  next  due.  Floor  inspection  person- 
nel have  the  responsibility  of  ensuring  that 
all  instruments  in  use  in  their  activity  area 
are  in  calibration.  If  a loan  pool  of  instru- 
ments is  available,  the  loan  instruments  should 
be  maintained  in  an  in-calibration  condition 
and  should  be  cycled  into  the  laboratory  for 
reealibration  at  the  same  intervals  as  instru- 
ments in  use  on  the  floor.  When  individual 
instruments  are  part  of  a complex  test  set-up 
whieh  is  in  constant  use,  it  is  feasible  to 
ealibrate  only  the  scales  on  the  instruments 
whieh  are  actually  used  in  the  set-up,  pro- 
vided that  the  instruments  are  marked  as 
being  usable  only  on  those  particular  scales. 

With  large  fixed  instruments,  or  with  de- 
licate moving  coil  instruments  used  for  highly 
accurate  measurements,  it  may  be  necessary 
for  calibration  personnel  to  carry  fixed  stan- 
dards from  the  calibration  laboratories  to  the 
instrument  into  the  laboratory.  If  this  is 
neeessary,  optimum  working  conditions 
should  be  provided  in  the  work  area  to  en- 
sure maximum  accuracy. 

Calibration  of  complex  measuring  and  en- 
vironmental systems  usually  is  performed  in- 
plaee,  although  some  eonsoles  may  be  trans- 
ported to  the  ealibration  laboratory.  The 
ealibration  should  be  performed  at  the  test 
leads  or  at  the  point  of  applieation  of  the 
environment  so  that  the  errors  introdueed  by 
eabling  and  switehing  or  by  the  input  fixtures 
of  environmental  equipment  will  be  deteeted 
in  the  ealibration  proeess.  For  eontrol  pur- 
poses, doors,  panels,  and  removable  instru- 
ments and  equipments  should  be  sealed  and 
break-of-inspeetion  proeedures  established  to 
ensure  that  any  ehanges  or  tampering  will  be 
deteeted  and  reealibration  performed.  The 
reealibration  interval  of  complex  equipment 
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must  be  established  by  careful  analysis  of 
drift  data,  but  it  usually  can  be  set  initially  to 
correspond  with  the  shortest  recalibration 
interval  of  any  standard  equipment  installed 
in  the  system.  Detailed  procedures,  in- 
cluding before  and  after  data  sheets,  are 
essential  to  calibrate  such  equipment  prop- 
erly. Audit  responsibilities  should  be  as- 
signed to  an  unbiased  inspection  group  to  en- 
sure that  the  procedures  are  meticulously 
followed. 

Standards  can  be  calibrated  in  two  ways: 

(1)  by  cross-checking  of  like  standards  held 
by  a laboratory,  and  (2)  by  comparison  of 
the  standard  with  a standard  of  higher  ac- 
curacy traceable  to  a comparison  with  a 
standard  held  by  the  National  Bureau  of 
Standards.  Cross-checking  is  relatively  easy 
and  inexpensive,  and  its  use  reduces  the  fre- 
quency with  which  the  standards  must  be 
referred  to  a higher-accuracy  standard. 
Certification  of  standards  is  a common 
practice.  Inspection  departments  should  be 
given  the  responsibility  of  auditing  all  the 
standards  in  the  chain  from  the  local-level 
standard  back  to  NBS  to  ensure  that  floor 
measurements  are  within  the  specified  ac- 
curacy. 

Detailed  calibration  procedures  for  both 
commercial  standard  measuring  equipment 
and  special  test  equipment  must  be  pre- 
pared and  used.  Calibration  usually  is  per- 
formed by  highly  skilled  technicians  who 
may  believe  that  they  can  dispense  with 
written  instructions  because  they  know  all 
the  steps.  The  errors  and  mistakes  which  re- 
sult from  this  overconfidence  are  frequently 
catastrophic,  particularly  since  other  project 
personnel  assume  that  the  calibrations  have 
been  properly  performed. 

Auditing  responsibilities  should  be  as- 
signed to  a “disinterested”  group  to  ensure 
that  detailed  procedures  are  prepared  and 
followed  by  calibration  laboratory  personnel. 
These  procedures  should  be  prepared  in 


great  detail  and  with  extensive  use  of  hook- 
up diagrams.  They  should  include  data 
sheets  that  require  recording  both  the  as- 
received  and  as-adjusted  readings,  and  the 
instrument  errors.  The  as-received  readings 
are  essential  to  permit  studies  of  drift  rates 
for  the  purpose  of  adjusting  recalibration 
periods  to  suit  individual  usage  conditions 
and  specific  drift  factors.  Calibration  pro- 
cedures prepared  by  instrument  manufac- 
turers are  not  always  detailed  enough  and 
must  frequently  be  rewritten. 

9-6  TEST  EQUIPMENT  RUGGEDIZATION 

Test  equipment  must  be  ruggedized  to 
minimize  the  loss  of  accuracy  in  laboratory 
or  field  use.  Measurements  made  with  in- 
adequately ruggedized  test  equipment  may 
introduce  errors  in  the  test  data.  In  addition, 
the  inadequate  test  equipment  may  be  in- 
capable of  performing  continuously  and 
consistently,  thus  destroying  the  effective- 
ness of  the  test  program.  Therefore,  it  is 
important  that  considerable  attention  is 
paid  to  ruggedizing  the  test  equipment.  When 
test  equipment  is  ruggedized  at  a point  in  the 
program  after  some  tests  have  been  run, 
great  care  must  be  taken  that  the  new  equip- 
ment does  not  introduce  undetected  changes 
into  the  system.  A convenient  check  on 
this  problem  can  be  made  by  making  com- 
patibility runs  and  testing  the  same  hard- 
ware on  both  the  old  and  the  new  test  equip- 
ment and  carefully  comparing  the  results 
before  the  new  test  equipment  is  released  for 
production  use. 

To  minimize  the  ruggedizing  cost,  the 
reliability  group  should  review  the  initial 
R&D  test  equipment  designs  to  ensure  that 
as  much  MIL-Spec  quality  material  as  pos- 
sible is  specified  and  that  the  original 
drawings  are  as  detailed  and  complete  as 
possible.  Although  this  approach  will  in- 
crease the  cost  of  the  R&D  test  equipment, 
it  will  result  in  considerable  net  savings  to 
the  project  by  reducing  the  amount  of  re- 
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design  and  rework  effort  for  ruggedization 
and  by  improving  the  overall  quality  of  both 
the  R&D  and  the  production  testing  efforts. 

9-7  TEST  FACILITIES 

One  of  the  more  difficult  decisions  facing 
test  management  personnel  is  the  make-or- 
buy  decision  for  the  many  kinds  of  testing 
which  comprise  the  reliability  test  program. 

The  straightforward  economic  factors 
involved  are  not  difficult  to  assess  by  com- 
mon methods  of  cost  accounting  and  analy- 
sis, and  further  discussion  is  not  warranted 
here.  However,  some  of  the  many  intangibles 
which  are  more  difficult  to  analyze  fre- 
quently override  or  modify  the  economic 
considerations. 

Good  management  practice  is  to  perform 
as  much  testing  in-house  as  possible.  This 
ensures  the  maximum  utilization  of  capital 
investments  and  of  the  work  force.  Schedules 
are  more  easily  monitored  and  a far  greater 
flexibility  can  be  attained.  Flexibility  is 
very  important  for  the  R&D  test  program,  in 
which  test  forecasts  can  change.  Control 
of  test  conditions,  discipline  of  test  oper- 
ations, and  liaison  between  the  laboratory 
and  other’organizational  elements  are  more 
easily  established  and  maintained  with  in- 
house  testing.  In-house  testing  eliminates  the 
necessity  for  training  outside  personnel  in 
company  techniques,  standards,  methods,  and 
systems  of  technical  and  financial  management. 
Also,  the  company  capability  and  capacity 
for  performing  tests  generally  are  improved  as 
the  in-house  test  load  broadens  and  increases. 

Balancing  factors  must  be  considered,  how- 
ever, which  frequently  result  in  a decision  to 
buy  test  services.  Time  may  be  an  overriding 
consideration.  The  in-house  laboratory  or 
test  facility  may  not  have  the  technical 
capability,  personnel  skills,  or  available  capac- 
ity to  perform  all  of  a required  test,  and  the 
time  to  obtain  them  may  be  longer  than  the 


project  schedules  will  permit.  Or,  even  if 
there  is  time,  the  required  test  may  be  very 
special  in  nature  with  little  likelihood  of 
being  repeated,  so  that  it  is  not  economically 
feasible  to  establish  an  in-house  capability. 

Sometimes,  a customer  may  decide  that  the 
testing  should  be  performed  in  an  outside 
laboratory  to  provide  an  unbiased  check  on 
project  performance,  or  he  may  have  his  own 
laboratories  and  decide  to  perform  the  testing 
there. 

Particularly  in  R&D  testing,  there  may  be 
very  sharp  peaks  and  valleys  in  the  scheduled 
or  actual  testing  load,  and  it  may  be  econom- 
ical for  the  company  to  buy  commercial 
laboratory  time  to  carry  the  peaks.  In  a 
multidivision  company,  sister  divisions  may 
have  very  low  utilization  factors  and  cor- 
porate management  may  dictate  the  inter- 
division transfer  of  a fixed  percentage  of 
testing.  There  is  distinct  merit  in  maintaining 
a group  of  competent  outside  laboratories 
who  are  familiar  with  the  company  and  are 
available  on  short  notice  to  take  care  of  un- 
planned emergency  requirements. 

It  is  generally  prudent  not  to  schedule  the 
in-house  laboratories  to  capacity;  there  must 
be  a reserve  of  unplanned  laboratory  time 
available  for  emergency  tests.  Qualification 
tests  are  not  intimately  connected  with  the 
production  process  and  should  also  be  per- 
fonned  in-house,  particularly  the  ambient 
tests.  Requalification  tests  can  be  split;  those 
tests  which  require  environments  not  avail- 
able in-house  should  be  performed  outside. 

The  reliability  department  should  monitor 
each  vendor’s  laboratory  to  provide  close 
liaison  and  direction  and  to  monitor  and 
audit  the  vendor’s  performance.  All  of  the 
company’s  in-house  disciplines  — including 
calibration  of  all  test  equipment,  preparation, 
release,  and  change  control  of  detailed  pro- 
cedures and  data  sheets,  operator  certifica- 
tion, and  independent  inspection  coverage  — 


9-6 


AMCP  706-198 


should  be  required  of  the  vendor  and  enforced.  procedures  reviewed,  approved,  released,  and 

It  may  be  desirable  to  have  the  vendor’s  controlled  in-house. 
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CHAPTER  10 
RELIABILITY  GROWTH 


L,  U = subscripts  which  imply  Upper  and 
Lower  uncertainty 

m(t)  = mean  number  of  failures  in  the 
interval  (0,  T] 

«,■  = number  of  failures  during  (par. 

10-2.2) 

rij-  = number  of  failures  in  the  interval 
(0,  T] 

t - time 

t,-  = time  at  which  failure  i occurred; 

test  time  of  unit  i (par.  10-2.2) 

T = time  at  which  prediction  is  made 

u(t)  = measure  of  uncertainty  in  In  \(t) 

P = constant  in  the  equation  for /Tift) 

XCtJ  = failure  occurrence  rate;  peril  rate; 

intensity  of  Poisson  process 

X-  = failure  rate  of  unit  i 

10-1  INTRODUCTION 

Contrary  to  conventional  wisdom,  a prod- 
uct when  it  comes  from  design  engineering, 
does  not  have  an  “inherent”  reliability  which 
is  then  degraded  by  the  manufacturing  de- 
partment. Rather,  the  product  contains 
weaknesses  which  are  removed  by  an  experi- 
ence-fix sequence.  Experience  includes 
design-development  testing,  production 
screening,  field  use,  etc.  - anyway  that  ex- 
perience with  the  product  is  obtained.  Fix- 


ing involves  changes  in  design  details,  pro- 
duction methods,  inspections,  etc. 

Not  all  fixes  cure  the  ills  they  were  sup- 
posed to  cure,  and  sometimes  fixes  introduce 
new  ills  that  weren’t  there  before.  This  is 
one  reason  that  the  Army  is  properly  skep- 
tical about  claims  that  product  ills  have  been 
cured,  when  there  is  no  physical  testing  to 
support  that  assertion.  It  is  also  reason  to 
be  skeptical  of  reliability  growth  models  that 
can’t  decrease. 

The  repeated  process  of  experience-fix  is 
called  Reliability  Growth.  Often  if  continues 
throughout  the  life-cycle  of  a product.  Since 
reliability  growth  ought  to  be  present  in  all 
programs,  it  is  desirable  to  have  a method  of 
predicting  what  the  reliability  will  eventually 
grow  to.  The  prediction  method  uses  a 
mathematical  model,  i.e.,  a set  of  equations 
whose  parameters  can  be  estimated  from 
historical  data  on  this  product  or  similar 
ones.  There  are  many  such  models,  only  one 
of  which  is  treated  in  detail  in  this  chapter. 

10-2  DUANE  MODEL 

The  Duane  model  (Refs.  1 and  2)  and 
modifications  thereof  are  based  on  the  idea 
that  the  more  resources  which  are  devoted 
to  finding  and  fixing  what  is  wrong,  the 
better  the  reliability  will  be.  The  model  is 
usually  expressed  as  “The  Tog  cumulative 
MTBF’  is  proportional  to  the  Tog  cumulative 
test-time’,  if  there  has  been  no  major  re- 
design.” This  statement  is  neither  clear,  nor 
complete,  in  several  ways: 

1.  The  concept  of  MTBF  ig  being  used 
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very  loosely.  Usually  (and  improperly)  the 
inverse  of  failure  rate  is  meant. 

2.  It  is  not  clear  whether  the  failure  rate 
of  the  item  is  constant  during  the  test 
(Poisson  process)  or  whether  the  failure  rate 
changes  during  the  test  (nonhomogeneous 
Poisson  process— see  Ref  3,  pp.  125-126). 

3.  The  rate  at  which  resources  are  de- 
voted to  the  project  must  stay  reasonably 
constant,  as  a function  of  test-time.  This 
requirement  eliminates  major  redesign  as  well 
as  major  shifts  in  effort. 

4.  Different  (and  possibly  incorrect) 
statements  of  the  exact  situation  reflect  the 
ambiguity  in  how  time  is  accumulated  and 
how  the  nonhomogeneous  Poisson  process 
is  precisely  defined. 


same;  if  j3  > 1,  the  reliability  is  getting 
worse.)  This  is  equivalent  to  saying  that  log 
failure  rate  is  a linear  function  of  log  time. 

Occasionally,  this  model  is  referred  to  as 
“WeibuH”  because  of  the  similarity  of  this 
nonhomogeneous  Poisson  process  failure- 
occurrence  rate  to  the  Weibull  failure  rate; 
but  the  basic  models  for  the  two  processes 
are  quite  different. 

Notation  follows: 

t - time 

T - time  at  which  a prediction  is 

made  (can  be  t„) 

tj  = time  at  which  failure  / occurred, 
a random  variable 


Only  one  of  the  possible  Duane  models  is 
analyzed;  another  is  merely  referenced.  The 
basic  assumption  of  constant  effort  (resource 
rate)  is  probably  the  limiting  factor  in  a 
satisfactory  prediction;  it  is  difficult  to  dem- 
onstrate, and  a poor-fit  of  the  data  to  the 
model  is  sometimes  used  as  evidence  that  the 
effort  is  not  constant.  The  arithmetic  in  the 
first  model  is  somewhat  easier;  so  perhaps  it 
deserves  to  be  tried  first. 

10-2.1  DUANE  MODEL  NO.  1 

The  following  assumptions  apply  : 


= number  of  failures  in  the  interval 
(0,  T] , a random  variable  unless 


m( t)  - mean  number  of  failures  in  the 
interval  (0,  t] 

\(t)  = failure-occurrence  rate  (intensity 

of  Poisson  process),  X( t)  = 
dm(t)ldt\  sometimes  called 
“peril  rate” 

j3  = constant  in  the  equation  for 
m(  t) 


1.  The  equipment  failures  are  described 
by  a nonhomogeneous  Poisson  process  (the 
failure  rate  is  a prescribed  function  of  time). 

2.  Time  is  the  cumulative  test-time  of  all 
units  on  test;  e.g.,  if  there  are  3 units  on 
test,  time  cumulates  at  3 times  the  clock- 
calendar  rate. 

3.  The  cumulative  number  of  failures  is 
directly  proportional  to  (Time)^,  where  /3  is 
a positive  constant.  (If  |S  < 1,  the  reliability 
is  growing;  if  /3  = 1,  the  reliability  stays  the 


u(t)  = a measure  of  the  uncertainty  in 

£n  xru 

implies  an  estimate  or  prediction. 
See  Appendix  B for  details 

L,  U = subscripts  which  imply  upper 
and  lower  uncertainty  limits 
on  X(U 

From  Appendix  B,  which  contains  the 
mathematical  details,  the  solution  for  the 
parameters  of  the  model  is: 
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'1  ",  TV* 

(10-1) 

- E In  r ) 

i=l  / 

mit) 

- nrit/Tf 

(10-2) 

\(t)  ■■ 

(10-3a) 

X(T) 

<00. 

Ill 

(10-3b) 

uit)  =m(T)[{1  + [1  +3  In  (^/T)]2}/2]1/2 

= m(D[[1  +{l  + In  [wW/nr]F]/2]‘/2 


(10-4a) 

u(T)  = (2/«r)i/2 

(10-4b) 

= Xit)  exp  [~  2u{t)] 

(10-5a) 

%j{t)  - k{t)  exp  [+  2u(t)\ 

(10-5b) 

The  uncertainty  limits  on  X (X^  and  X^^) 
are  approximate  and  are  chosen  at  twice  the 
estimated  asymptotic  standard  deviation  of 
£n  X.  They  have  no  exact  probabilistic  inter- 
pretation, but  serve  adequately  for  engineers 
and  managers  who  want  to  know  whether 
the  estimate  is  within  10%  or  a factor  of  10. 
Indeed,  the  factor  of  2 on  u could  as  easily 
have  been  3. 

For  u(T)  small,  i.e.,  u(T)  « 1,  the  relative 
uncertainty  in  X is,  from  Eqs.  10^  and  10-5; 
± 2 Uj-  = y/S/fij-;  thus  to  know  ‘kj-  within 
± 10%  requires  about  800  failures  (n,  = 800). 
For  most  situations  this  is  an  outlandish  num- 
ber, which  shows  that  rarely  will  we  know 
X to  within  ± 10%. 

Statisticians  are  divided  on  the  worth  of 
running  goodness-of-fit  tests.  The  reasons 
for  not  paying  much  attention  to  them  are 
that  their  interpretation  is  narrowly  statis- 
tical, rather  than  engineering,  and  that  the 
result  tends  to  be  very  sensitive  to  the  size 
of  the  sample  (number  of  failure-occurrences). 
For  any  physical  situation,  it  is  usually  pos- 
sible to  take  so  few  data  that  the  model 


being  considered  is  rarely  rejected,  or  to 
take  so  many  data  that  the  model  is  virtually 
always  rejected.  Usually,  the  uncertainty  in 
the  projected  value  of  X(t)  will  be  dishearten- 
ing enough. 

Example  No.  37  illustrates  the  procedure. 
10-2.2  DUANE  MODEL  NO.  2 

The  following  assumptions  apply ; 

1.  There  are  2 kinds  of  time: 

a.  The  cumulative  test-time  of  all  units 
on  test,  up  to  the  time  of  the  last  fix. 

b.  The  test  time  of  a unit,  as  measured 
from  the  time  of  its  most  recent  fix. 

2.  The  failure  rate  of  a unit  is  constant 
between  fixes. 

3.  The  log  failure-rate  of  a unit  when  it 

is  fixed  is  a linear  function  of  log  cumulative- 
test-time  (see  Assumption  la). 

Notation  follows: 

tj  = test  time  of  unit  i (see  Assumption 
lb) 

Tj  = cumulative  test-time  of  all  units  on 
test,  up  to  the  time  of  the  last  fix 
for  unit  i (see  Assumption  la),  t,-  and 
Tj  are  independent. 

rij  = number  of  failures  during 

\ - failure  rate  of  unit  i 

From  Assumption  3,  it  follows  that 

In  = *0  + (/3  - 1)  In  Ti  (10-6) 

Eq.  6 has  the  formalism  of  Ref.  4,  where  the 
j3  — 1 and  SnT,-  of  Eq.  10-6  correspond  to 
the  E and  x,-  of  Eq.  1 2 in  Ref  4,  respective- 
ly. The  solution  for  X,-  and  the  uncertainties 
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Example  No.  37 

Several  pieces  cf  the  same  equipment  are  being  tested  in  conjunction  with  a reli- 
ability-growth program.  After  1200  total  hours  of  testing  time,  there  have  been  8 
failures.  The  individual  failure  times  (not  shown  here)  were  used  to  calculate/?  = 0.6 
from  Eq.  10-1.  What  is  the  current  failure  rate,  and  what  is  it  estimated  to  be  if 
there  are  1800  more  hours  of  testing?  (Since  jS  < 1,  the  failure  rate  is  decreasing.) 

Procedure  Example 


1,  State  the  data  (and  calculated 
results)which  are  given. 


2.  Find  X(T)  and  u(T).  Use  Eqs. 
10-3b  and  10-4ta, 


3,  Find  Xl(T)  and  \u(T).  Use 
Eq.  10-5, 


4,  Find  t after  1800  more  hours. 


5.  Find  mU),  X(t),  Use 

Eqs,  10-2,  10-3a,  10-4a, 


6.  Find  Xx(t)»  Use  Eq, 

10-5.  Calculate  the  ratio  of 


1.  T=  1200  hr 
n-r  = 8 

$ = 0.6. 

2.  A(T)  = (0.6)(8)/1200-hr 

= 4.0/1000-hr 
am  = (2/8)^^2  ^0^5^ 

3.  2m(D  = 2(0,5)  = 1.0 

\j^(T)  = (4.0/1000-hr)^’ 

= 1.5/1000-hr 

\um  = (4.0/1000-hr)^* 

= 10.9/1000-hr. 

4.  t = 1200  hr  + 1800  hr 

= 3000  hr. 

5.  t/T  = 3000  hr/1200  h r = 2.5 

m(t)  = 8(2.5)®-®  = 13.86. 

Ht)  = (4.  0/1000-hr)(2. 5)®'® ' ^ 
= 2.77/1000-hr 

u(t)  = 0.5{[1  -I-  (1  -I-  0.6  ln2. 5) 
= 0.652. 

6.  2i^(f)  = 2 X 0.652  = 1.30 

Ai(#)  = (2.77/1000-hr)e'  ^-®® 

= 0.75/1000-hr 

= (2.77/1000-hr)e*  ^-®® 

= 10.2/1000-hr. 
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7, 


Example  No.  37  (Cont'd) 

Compare  results  of  steps  3 7,  = 10.2/0.75  = 13.6;  and 

and  6.  are  about  the  same;  %iit)  is  about  one- 

half  of  for  this  problem,  So  the  extra 

1800  hr  of  testing  will  achieve  at  most  a fac- 
tor of  2 improvement  in  failure  rate,  but 
might  do  no  good  at  all, 
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is  more  complicated  in  this  case  than  in  par. 
10-2.1.  and  probably  isn’t  worth  the  extra 
trouble,  since  the  uncertainties  are  going  to 
be  large  in  either  case.  The  computer  pro- 
gram in  Ref.  4 would  have  to  be  modified  to 
account  for  the  new  variables. 

10-3  OTHER  MODELS 

A large  number  of  mathematical  models 
are  possible  for  reliability  growth.  Many  of 
them  can  fit  any  particular  set  of  historical 
data  reasonably  well.  The  real  question,  how- 
ever, is  how  well  they  allow  you  to  estimate 
current  reliability  and  to  predict  its  future 
value. 

Refs.  5 and  6 each  compare  several  models 
with  simulated  data.  Ref.  5 is  limited  to 
binomial  data  (success-failure).  Ref  6 in- 
cludes the  Duane  model  in  its  comparisons. 
Ref.  7 analyzes  the  Duane  model.  Unfortu- 
nately, veiy'  few  references  show  how  to 
estimate  the  uncertainty  in  reliability-growth 
predictions.  No  statistical  point  estimate  is 
worth  very  much  unless  it  is  accompanied  by 


some  measure  of  its  uncertainty. 

One  big  difficulty'  with  choosing  a model 
is  to  be  aware  of  all  the  answers  that  are 
part  of  the  model,  rather  than  part  of  the 
data.  As  an  absurd  extreme,  if  the  model  is 
chosen  so  that  there’isa  lower  limit  on  fail- 
ure rate,  one  ought  not  to  be  surprised  at  the 
statistical  predictions  from  the  model  and 
data  that  there  is  a lower  limit  on  failure 
rate. 

A reliability  statistician  can  help  you 
create  a growth  model  that  you  are  willing 
to  live  with.  The  cost  of  analyzing  the  model 
will  generally  be  negligible  compared  to  the 
cost  of  the  physical  tests.  In  the  absence  of 
such  help,  one  can  plot  — logR  against  “some 
measure  of  program  resources  consumed  so 
far”  where  R is  the  estimate  of  reliability 
from  the  most  recent  test.  If  there  are  a 
great  many  data,  the  form  of  the  curve  will 
be  obvious.  If  there  are  very  few  data,  the 
seatter  on  the  graph  will  emphasize  your 
irredueible  uneertainty. 
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APPENDIX  A 

ENVIRONMENTAL  SPECI  FICATIONS 


A-1  INTRODUCTION 

Material  from  Refs.  1 and  2 is  presented 
whieh  permits  the  engineer  to: 

1.  Keep  traek  of  environmental  specifica- 
tions for  both  military  and  nonmilitary  parts 

2.  Find  the  environmental  requirements  of 
a Military  Specification 

3.  Compare  various  requirements  at  a 
glanee. 


A-2  A QUICK  GUIDE  TO  ENVIRON- 
MENTAL SPECIFICATIONS  (REF.  1) 

Trying  to  keep  track  of  the  various  en- 
vironmental requirements  of  Military  Speei- 
fications  can  be  a nightmare,  particularly 
when  the  engineer  is  working  on  several 
different  types  of  equipment  simultaneously. 
To  alleviate  this  problem,  the  important  data 
from  the  common  specifications  (listed  in 
Table  A-1)  have  been  tabulated  and  grouped 
in  Table  A-2. 


TABLE  A-1 

LIST  OF  SPECIFICATIONS 

i(Thelist  shows  the  Standard  and 
revision  considered  in  Ref.  1) 


MIL-STD-810 

Environmental  Test  Methods  (Equipment) 

STANAG3518 

NATO:  EnvironmentalTest  Methods  for  Aircraft 
Equipment  and  Associated  Ground  Equipment 

MIL-E-4158  (USAF) 

Electronic  Equipment  Ground;  General  Require- 
ments for 

MIL-E-5272  (ASG) 

Environmental  Testing,  Aeronautical  and 
Associated  Equpment; General  Specification  for 

MIL-E-5400 

Electronic  Equipment,  Aircraft;  General 
Specification  for 

MIL-T-5422  (ASG) 

Testing,  Environmental,  Aircraft,  Electronic 
Equipment 

MIL-E-1 6400  (NAVY) 

Electronic  Equipment,  Naval  Ship  and  Shore; 
General  Specification  for 

MIL-T-21200 

Test  Equipment  for  use  with  Electronic  and  Fire 
Control  Systems;  General  Specification  for 

MIL-STD-202 

Test  Methods  for  Electronic  and  Electrical 
Component  Parts 
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ENVIRONMENTAL  SPECIFICATIONS  SUMMARY' 


SHOCK 


Specification 

Details . 

Handling 

Oesrqn 

Crash 

Hi  Impact 

Pulse 

Notes 

MIL-STD810B* 

516 

Pr.  H 

V 

VI 

Drop 
Bench 
Rail  Imp. 

■ 

15$  linns 
40918ms 
209  11ms 
409  18ms 

half-s. 

half-s. 

SMVt. 

sawt. 

Air 

Ground  , 

Air 

Ground 

30g  1 1ms 
759  11ms 
40g  1 1ms 
75$  Urns 

half-s. 

half-s. 

sawt, 

sawt. 

Air 

Ground 

4if 

Ground 

lOOgSms 
lOOg  6ms 
IOO9  6ms 
IOO9  Urns 

half-s. 

half-s. 

sawt. 

saws. 

STANAG  3518 

15j 

3a 

3b 

as  spec. 

s spc. 

MILE-4158C 

3223^ 

ij  specified 

MIL-E-5272C 

4.15 

Pr.  Il-V 
I-IV 
Iff 

159  1 1ms 

30g  11ms 
50g  8.5 

as  <p«c. 

half-s. 

MIL-S4456 

JAN-S-44 

MIL-S-901 

MIL-E'5400-J 
.MIL-T-5422  E 

3,2.21.6 

4.3 

Ibg  1 ims 

309  Urns 

MIL-E-16400E 

3.1  1.8.1 

4.5.14.1 

1 

1.3.5  ft. 
400  lb. 

MIL-S-SOl.Gr.A 

MIL-7.21200C 

3.2.16.5 

4.32.1 

30g  1 1 ms 

SMOCK 

Specification 

Method 

Condition 

Handling 

Design 

Hi  Impact 

Pulse 

Notes 

MIL-STD-202 

203A 

Drop 

for 

semiconductor 

202  fi 
<4lbi 

SB  specified 

205  C 
<300  lbs 

A 

B 

C 

15g  11  ms 
3O9  n ms 
5O9  Urns 

■ 

213 

A 

B 

C 

f ^ 

6 

preftrred  ..  ^ 

G 

H 

I 

50g  Urns 

76g  6ms 

IOO9  6mr 

500g  1ms 

lOOOg  .5ms 

1500g  .5ms 

50$  10ms 
759  6nn 

lOOg  6ms 

half-t. 

haif-s, 

haif-s. 

half-s. 

half-1. 

sawt 

sawt 

sawt 

2b7 

<300  lbs 

1.3,5  ft 
•400  lbs 

MIL-S-901, 

Class  HI 
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Table  A-2  is  arranged  according  to  the  type 
of  test  — altitude,  temperature,  temperature/ 
altitude,  vibration,  shock,  and  humidity. 

Along  with  quickly  spotting  a specific  re- 
quirement for  a specification,  various  specifi- 
cations for  similar  tests  can  be  compared.  If 
complete  details  are  needed,  then  consult  the 
applicable  document.  Table  A-2  makes  this 
even  easier  by  giving  the  specific  paragraph  in 
the  specification  that  has  the  needed  infor- 
mation. 

A-3  ENVIRONMENTAL  CODE:  A SHORT- 
CUT TO  SPECIFICATIONS  (REF.  2) 

Military  Specifications  describe,  often  at 
great  length,  the  environmental  parameters 
of  military  electronic  parts  and  equipments. 
These  detailed  requirements  are  needed  to 
ensure  accuracy,  but  they  are  difficult  to 
record  and  to  compare.  A short,  simple 
method  of  specifying  the  exact  parameters  is 
presented. 

The  Environmental  Code  (EC)  consists  of 
a 10-digit  number.  The  position  of  each 
digit  defines  a specific  parameter,  while  the 
value  of  the  digit  represents  a particular  level 
of  that  parameter. 

For  example,  the  first  digit  always  repre- 
sents altitude,  the  second  represents  high 
operating  ambient  temperature,  and  so  forth. 


If  the  first  digit  is  a 1,  then  this  specifies 

15.000  ft  altitude,  whereas  a 6 represents 

100.000  ft.  In  this  way,  10  different  en- 
vironmental parameters  are  represented  in 
the  code  (see  Fig.  A-1). 

The  Environmental  Code  Table  (Table  A-3) 
lists  the  various  levels  for  each  parameter  a- 
long  with  the  corresponding  code  number.  In 
addition,  the  test  methods  for  parts  are  listed 
as  per  MIL-STD-202.  These  methods  are  not 
the  only  ones  to  be  used  since  different 
parts  and  equipments  use  different  Military 
Speeifieations,  some  of  which  are  shown  in 
Table  A-4.  In  general,  an  item  to  be  coded 
should  be  tested  according  to  its  relevant 
specification.  Since  it  is  the  document  most 
commonly  used  in  evaluating  electronic  parts, 
MIL-STD-202  is  the  basis  for  EC. 

Occasionally  the  levels  in  Military  Specifi- 
eations  are  slightly  different  from  the  levels 
in  EC.  In  that  ease,  the  deviation  is  indicated 
by  an  asterisk  next  to  the  appropriate  eode 
number.  For  example,  MIL-E-16400F 
speeifies  the  temperature  + 50*C,  while 
MIL-E-4158C  speeifies  + 52X.  Both  of  these 
temperatures  would  be  represented  by  a 1 * 
in  the  seeond  position  of  the  EC,  indicating 
that  the  temperature  is  close  to,  but  not 
exactly,  + 55°C. 


HIGH  AMBIENT 
TEMPERATURE 


VIBRATION 


CORROSION 


MOISTURE 

RESISTANCE 


■ SHOCK 


FLAMMABILITY  8 
EXPLOSIVENESS 


0 


(HOURS)  (CYCLES) 


Figure  A-1.  The  Environmental  Code  fECP 
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TABLE  A-3 


ENVIRONMENTAL  CODE  TABLE^ 


for  Military  Electronic  Parts  and  Equipmants 


Levels 

Detonate  the  required  le^l 
by  the  appropriate  digit. 


Test  Methods 

Test  Methodsspecified  are  for  parts  as  in 
MIL’STD-202.  For  Equipments,  use  the 
applicable  methods  of  Mll.*STD*810. 
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TABLE  A 4 


USE  OF  MILITARY  SPECIFICATIONS- 
Military  Specifications 

Name  Contents  Used  For 


MIL-STD-202 
Ml  L-STD-750 
MIL-STD-883 
MIL-STD-810 


Test  methods  for  electronic  and  electrical  component  parts 
Test  methods  for  semiconductor  devices 
Test  methods  and  procedures  for  microelectronics 
Environmentaltest  methods 


Parts  i n general 
Semiconductors 
Microelectronics 
Equipments 


% coding  the  Military  Specifications  them- 
selves, the  coded  parts  and  equipments  can 
be  compared  to  the  specifications.  The 
Military'  Specifications  need  only  be  coded 
once,  sinee  they  apply  as  long  as  the  speeifi- 
eation  remains  unehanged.  Some  sample 
eodings  for  parts  and  equipment  speeifieations 
are  shown  in  Table  A-5. 

It  is  easy  to  eode  Military'  Speeifieation 
parts.  But  what  about  non-military'  (Non-MS) 
parts?  They  ean  also  be  eoded  if  aeeeptable 
test  evidenee  exists.  By  eomparing  the  EC’s 
for  these  parts  with  the  eode  of  an  equip- 
ment, parts  evaluation  ean  be  simplified. 

For  example,  if  the  equipment  EC  is 

3 14-24-400-00 

and  the  EC’s  of  two  parts  are 

Resistor  (MIL-R-llF)  324-75-400-00 

Resistor  (Non-MS)  334-53-400-FO 

then  a eomparison  will  show  that  the  digits 
of  the  resistors  are  equal  to  or  higher  than 
those  of  the  equipment.  Hence,  both  resistors 


meet  the  environmental  requirements  of  the 
equipment. 

If  however,  some  of  the  digits  of  a part 
are  lower  than  the  eorresponding  digits  in 
the  equipment  eode,  it  is  immediately  known 
that  the  part  is  not  suitable  for  the  equipment. 

This  environmental  eode  was  developed  in 
1963  and  is  used  by  the  Canadian  Military 
Electronics  Standards  Agency  (CAMESA)  for 
its  evaluation  procedures  of  nonstandard 
parts.  CAMESA  is  the  Canadian  military 
agency  for  electronic  parts. 

The  original  code  contained  other  param- 
meters  such  as  reliability,  sunshine,  rain;  and 
radiation;  but  these  have  been  deleted  for  the 
sake  of  simplicity'. 

In  general,  EC  provides  an  accurate,  easy 
way  to  define  the  environmental  character- 
istics of  electronic  parts  and  equipment.  It 
greatly  simplifies  parts  evaluation,  especially 
when  large  numbers  are  involved.  It  is  a 
simple  and  effective  information  retrieval  sys- 
tem, and  can  be  used  either  manually  or  with 
computers. 
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TABLE  A S 

SAMPLE  ENVIRONMENTAL  CODES^ 


Parts  Specs 

MIL-R-11F,  Resistor 

MIL-R-93D.  Resistor 

MIL-STD-446A,  Group  I 
Group  II 
Group  III 
Group  IV 
Group  V 
Group  VI 
Group  VII 
Group  VII I 

Equipment  Specs 

MIL-E-5400J,  Class  I 
Class  lA 
Class  2 
Class  3 
Class  4 

MIL-E-16400F,  Class  1 
Class  2 
Class  3 
Class  4 


Environmental  Code 


3 2 

4- 

75- 

40 

0-  DO 

6 5 

5- 

7 5- 

46 

0-0*0 

1*1 

4- 

14- 

45  3 - JO 

4 3 

5- 

55- 

45 

3-  J 0 

1*5 

5- 

55- 

45  3-J  0 

6 5 

5- 

55- 

45 

3-  FO 

6 7 

5- 

65- 

45 

3-  J*0 

7 7 

5- 

65- 

45 

3-  FO 

7 8 

5- 

75- 

45 

3-  FO 

7 9 5 - 

8*5- 

4 5 

3-  1 0 

Environmental  Code 

3 1 4 - 2’4’  - 1 7 2-00 
2 1 4 -2*4’  - 1 7 2-00 

4 2 4 - 2*4*  - 1 7 2-  00 
6 4*4  -2*4*  - 1 7 2 - 00 
6 5 4 -2*4*  - 1 7 2 - 00 
0 2*4-  1 7 -4*l*0-0  0 
0 2*2-  1 7 -4*r0-0  0 
0 1*3-1  7 -4‘l*0-0  0 
0 1*1  - 17  -4*1*0  -0  0 


REFERENCES 


1.  R.  Wemick,  “A  Quick  Guide  to  Environ- 
mental Specification”,  The  Electronic 
Engineer,  March  1969. 


2.  R.  Wcmick,  “Environmental  Code:  A 
. Shortcut  to  Specifications”,  The  Elec- 
tronic Engineer,  September  1969. 
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APPENDIX  B 

ESTIMATES  FOR  RELIABILITY-GROWTH,  DUANE  MODEL 


LIST  OF  SYMBOLS 

AVar,  ACov  = asymptotic  variance  and 
covariance,  respectively 

c = j3  In  r 

C = j3  In  ? 

£1..  = s-expeeted  value  of  seeond 

derivative  of  L with  respeet 
to  the  variables  i and  /; 
oy  eorresponds  to  either  i 
or  / = 1 and  13  eorresponds 
to  either  i or  / = 2 

L,  U = subseripts  whieh  imply 

Lower  and  Upper  bounds, 
respeetively 

L*,  L = Likelihood,  -In  Likelihood, 

respectively 

m(t)  = mean  number  of  failures 

in  (0,  T] 

n = number  of  failures  in  (0,  T] 

s = implies  the  word  “statisti- 

cal(ly)”  or  implies  that  the 
technical  statistical  defini- 
tion is  intended  rather  than 
the  ordinary'  dictionary' 
definition 

t,-  = time  of  failure  i 

T = fixed  time  of  test 

u(t)  = measure  of  uncertainty  in 

In  \(t) 


a = positive  constant 

^ = positive  eonstant 

Xf/yl  = dm(t)fdt,  peril  rate 

n,-,  S,-  = produet  and  sum,  respec- 

tively, over  i from  Ito  « 

The  Duane  Model-1  is  a partieular  non- 
homogeneous  Poisson  proeess  wherein 

mit)  = at^  (B-1) 

Notation  follows: 

mf t)  = mean  number  of  failures  in  (0,  t] 

O',  |3  = positive  eonstants 

'idt)  = dm(t)ldt  = ; peril  rate 

T = fixed  time  of  test 

n = number  of  failures  in  (0,  T]  ,a 
random  variable 

= time  of  failure  i,  a random 
variable 

n,-,  2,-  = product  and  sum,  respectively, 
over  i from  1 to  « 

L*,  L = Likelihood,  — In  Likelihood, 
respectively 

The  statistical  procedure  used  here  to  esti- 
mate oy,  )3,  and  their  uncertainties  is  Maximum 
Likelihood.  The  Likelihood  is  the  probabil- 
ity and/or  probability  density  that  the  actual 
results  would  be  found. 
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Parzen  (Ref.  l,p.  143)  has  shown  that: 

1.  The  eonditional  Cdf  of  the  failure  time 
is 

Cdf{t\niT}  = m(t)/m(T),  forO:<t<T; 

the  eondition  is  that  the  number  of  failures 
n is  known. 

2.  The  failure  times  behave  as  if  they 
were  s-independent. 

The  Pr  {n;T ) is  the  same  for  a nonhomo- 
geneous  proeess  as  it  is  for  a homogeneous 
one,  i.e., 

■Pr{«iT}=exp  [- w(T)][w(T)]"/«!  (B-2) 
The  Likelihood  is 

L*  = [Uipdfiti  I n;  T} jPr{n-,  T}  . (B-3) 

It  is  tedious  but  straightforward  to  show 
that  (the  random  variables,  t,-  and  n,  are  the 
constants;  the  2 parameters  a and  jS  are  the 
variables): 

L s - In  L*  = - « In  {ajS) 

— ip  - l)2j  In.ij  + aT^  Tconstant 


The  Maximum  Likelihood  solution  is  obtained 
by  setting  Eq.  B-4  to  zero  and  solving  for  a, 

P’>  where  * denotes  the  Maximum  Likelihood 
solution. 

p = n/Sj  In  (T/ti)  (B-5a) 

a = n/T^  (B-5b) 

The  uneertainties  are  evaluated  by  the 
Fiseher  Information  matrix.  For  this  pur- 
pose, the  s-expeeted  values  of  the  seeond 
derivatives  of  L are  needed. 

Additional  notation  follows: 

C = |31nT 

c = pin  t 

D = EL11EL22  -ELI2 

ELij  = s-expected  value  of  the  second 

derivative  of  L with  respect  to  the 
variables  i and  /;  # 1 corresponds 
to  a, #2  corresponds  to  P 

The  second  partial  derivatives  of  L are: 

ft  2 r 

T2  = a^’®  = w(r)  (B-6a) 

” 9(lna)‘‘ 


(B-4) 


Sinee,  in  the  Likelihood  methods,  monotonie 
transformations  of  the  variables  or  Likelihood 
don't  ehange  the  basie  results,  all  the  partial 
derivatives  are  with  respeet  to  In  a and 
In  P,  beeause  the  results  are  more  eonvenient. 
It  is  again  straightforward  to  show  that: 


dL 

8 In  a 


n + aT^ 


(B-4a) 


dL 

8 ln/3 


— n — p'L^  In  ti 


L = 

8 In  cn  8 In  /3 

= {p  In  T)aT^=  Cm  (T)  (B-6b) 

d^L 

^22  = 9(ln^)2  -~^^i  U 

+ ip  In  T)aT^  + {p  In  T)^aT^ 

= - S,  In  [(IJ]  + Cbn(T) 

-n  + Cm(T)]  (B-6c) 


+ /3(ln  Dar® 


(B-4b)  Xhe  random  variables  t,-  and  n appear  only 
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in  Eq.  B-6c.  The  s-expected  value  of  n is 
miT)  for  a homogeneous  or  nonhomogeneous 
Poisson  process.  The  s-expected  value  of 

-miiTy 

= - = + 1 (B-7) 

0 

where  x = {tjITf.  Use  ELq  to  denote  the 
s-expected  \alue  of  L,y  and  take  the  s-ex- 
pected values  of  Eqs  B-6. 


EL^^  = m{T)  (B-8a) 

£1.12  = Cm(T)  (B-8b) 

EL22  = m{T)  (1  + C^)  (B-8c) 

D=[m(T)]^  (B-9) 


Eq.  B-8  contains  the  elements  of  the 
Fischer  Information  Matrix.  The  covariance 
matrix  is  the  inverse  of  the  Fischer  Informa- 
tion matrix.  Therefore  the  asymptotic 
covariance  matrix  for  2n  a and  £n  /3  is 

Avar  (In  a ) = [l/m  (D]  (1  + C^)  (B-lOa) 

ACovdn  a,  In  0)  = - [l/m{T)]C  (B-lOb) 

AVar(ln^)  = [l/w(r)]  (B-lOc) 

where  AVar  (•)  and  ACov  (•)  stand  for  the 
asymptotic  variance  and  covariance,  respec- 
tively. 

In  practice  these  are  estimated  by  using  the 
Maximum  Likelihood  estimates  for  cr,  |3,  and 
m{T);  namely,  a,  P,  n.  (C  = pin  T,  c = ^nt). 

The  estimates  for  m( t)  and  Af t)  are 
m{t)  = ai®  = n{t/T)^  (B-lla) 


X(f)  =apt^'^  = 

= X(T)(f/D®‘‘  (B-llb) 

X(T)  = pn/T  (B-llc) 

The  uncertainty  in  A is  estimated  by  using 
the  linearized  expansion  of  2nA  , differentials, 
and  the  usual  formula  for  variance  of  a linear 
function. 

In  A(f)  =lna  +lnp  +(p  - l)ln  t 

(B-12a) 

d In  A(^)  = d\na  + d la  p 
+ (p  In  t)d  In  p 
= d la  a + (1  + c)d  In  p 

(B-12b) 

[«(U]^  = AVar  {in  A(i)} 

AVar  {in  a}  + (1  + c)^AVar{ln  jl} 
+ 2(1  + c)ACov  {in  a,  In 
= {l  +[1  +0  In  (t/T)]yn 

(B-13a) 

m(T)=V27^  (B-13b) 

where  ti( t)  is  an  estimated,  asymptotic 
standard  deviation  for  n( t). 

The  “point  estimate  plus  or  minus  2 
standard  deviations”  is  used  to  estimate  the 
uncertainty  in  In  yt).  The  factor  of  2 is 
arbitran,’;  conventional  wisdom  in  the  USA 
often  uses  3 standard  deviations,  but  that 
seems  excessive  here.  There  is  no  “right” 
answer,  nor  does  the  uncertainty  have  an 
exact  probabilistic  interpretation.  But  it  is 
a very  useful  tool  for  engineers  and  managers. 
Roughly  speaking,  the  interval  of  uncertainty 
is  such  that  no  one  has  the  vaguest  idea 
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where  in  the  interval  the  true  value  lies,  but 
you  are  quite  sure  it  lies  in,  or  reasonably 
elose,  to  that  interval. 

The  biggest  reason  that  this  concept  is 
satisfactory  is  that  often  the  region  of  un- 
certainty is  so  large  that  the  main  message 
to  the  user  is  that  he  knows  much  less  than 
he  hoped;  or  in  a few  cases,  the  region  will 
be  narrow  enough  that  the  user  is  quite 
satisifed,  and  would  be  even  if  the  uncertaintv’ 
were  somewhat  larger. 

The  upper  and  lower  limits  of  the  region 
of  uncertainty  for  £n  X(t)  are 

In  = In  \{t)  — 2u(t)  (B-I4a) 

In  = In  \(^)  + 2u(t)  (B-I4b) 


or 

XxW  =\(t)  exp  [-  2u{t)] 

(B-15a) 

\u(t)  = \{t)  exp  [+  2u{t)] 

(B-15b) 

The  estimates  are  mathematically  well  be- 
haved; e.g.,  it  is  easy  to  see  that  &, 

\i/( t)  are  always  positive. 

This  derivation  has  been  for  the  case  where 
the  stopping  rule  is  to  stop  after  a fixed 
length  of  time  (cumulative  test  time  of  all 
units).  Maximum  Likelihood  results  are  often 
the  same  whether  the  stopping  rule  is  for  a 
“fixed  time”  or  a “fixed  number  of  failures”. 
These  estimates  can  be  used  regardless  of 
which  kind  of  stopping  rule  is  invoked. 


REFERENCE 

1.  E.  Parzen,  Stochastic  Processes,  Holden- 
Day,  Inc.  San  Francisco,  1965. 
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INDEX 


A 

Accelerated  life  test,  3-1 8,  7-1 
mathematical  models,  7-9,  7-1 1 
qualitative,  7-1 
quantitative,  7-2 
Acceleration 
factor,  7-2 
true,  7-2 

Accept/reject  test 

t-test  for  s-normal  mean,  2-96 
binomial  parameter,  2-100 
nonparametric,  2-109 

maximum-deviation,  2-109 
rank-sum,  2-109 
runs,  2-109 

Analysis  of  variance,  2-78 

1 - factor,  2-8 1 

2- factor,  2-85 

3- factor,  2-85 
Attributes  tests,  3-10 

B 

Bayes  formula,  3-39,344 
Bayesian  statistics,  3-38 
Beta  bounds,  See:  Plotting  position 
Binomial  distribution 

analytic  estimation,  2-37,  3-18 

C 

Chi-square  test  (goodness-of-fit),  2-64 
COFEC,  5-10,  5-1 1 
Component  model,  2-1  15 
Computer  programs  (data  system),  5-10 
Concepts,  3-3 

s-Confidence,  2-37,  2-50,  2-55,  2-63,  2-71,3-5 
Conjugate  prior  distribution,  3-44 
Consumer  risk,  3-5 
Correlation,  2-93 
Cumulative  damage,  7-6 

D 

Data  format,  5-2 


Data  system,  1-1,  1-3,  5-1 
existing  systems,  5-30 
operation,  5-12 
reporting,  5-21 
structure,  5-2 
Discrimination  ratio,  3-4 
Duane  model,  10-1,  B-1 

E 

Environmental 
effects,  6-3,  A-1 
specifications,  A-1 
testing,  6-1 

simulation,  6-6 
Experimental  design,  3-8 
Exponential  distribution 

analytic  estimation,  2-55,  2-73,  3-25 
graphical  estimation,  2-1 8 

F 

Failure 
law,  3-17 

modes  and  mechanisms,  7-4,  7-5 
reporting,  5-14 

G 

GIDEP,  5-30 
Goodness-of-fit  test,  2-64 
chi-square  test,  2-64 
Kolmogorov-Smimov  test,  2-65 
Graphical  estimation,  2-5 

See  also:  Name  of  the  distribution 
(lognomial,  s-normal,  Weibull) 

H 

Holography,  8-2 
Hypothesis 
alternate,  3-3 
null,  3-3 
test,  3-3 
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I 

Infrared  evaluation 

See : Thermal  evaluation 
Integrated  data  system,  5'ee;  Data  system 

K 

Kolmogorov- Smirnov  test 
5-Confidence  limits  on  Cdf,  2-71 
goodness-of-fit,  2-65 
K-S  bounds,  See : Plotting  position 

L 

Liquid  penetrants  (for  NDE),  8-7 
Life  test 

accelerated.  See:  Accelerated  life  test 
Bayesian,  3-44 
Lognormal  distribution 
analytic  estimation,  2-63 
graphical  estimation,  2-27 

M 

Magnetic  evaluation,  8-8 
Microscopy,  See : Optical  evaluation 
Military  Specifications 
MIL-E-41 58,  A-1  et.  seq. 
MIL-E-5272,A-1  et.  seq. 

MIL-E-5400,  A-1  et.  seq. 

MIL-E- 16400,  A-1  et.  seq. 
MIL-T-5422,A-1  et.  seq. 
MIL-T-21200,A-1  et.  seq. 

Militaiy  Standards 
MIL-STD-105;  1-2 

MIL-STD-202;  A-1,  A-3,  A-4,  A-5,  A-7, 
A-10 

MIL-STD-750;A-10 
MIL-STD-781;  1-2,  4-9 
MIL-STD-785;  1-1 
MIL-STD-8  10;  6-6,  A-10 
MIL-STD-83 1;  5-16 
MIL-STD-883;  A-10 

N 

NDE,  See:  Nondestructive  evaluation 
NDT,  See:  Nondestructive  testing 
Nondestructive  evaluation,  8-1,  8-2,  8-3 


Nondestructive  testing.  See:  Nondestructive 
evaluation 

Nonparametric  estimation,  2-77 
s-Normal  distribution 

analytical  estimation,  2-56,  3-35 
graphical  estimation,  2-1 1,  2-13,  2-16, 
2-19,  2-22,  2-23 

O 

Operating  characteristic,  3-6 
Optical  evaluation,  8-1 

P 

Parametric  estimation 
analytic,  2-49 
binomial,  2-49 
exponential,  2-55 
lognormal,  2-63 
s-normal,  2-56 
Poisson,  2-50 
Weibull,  2-63 
graphical,  2-5 
lognormal,  2-27 
s-normal,  2-1  1 

plotting  positions,  2-5,  2-6,  2-7 
Weibull,  2-18 
Plotting  positions,  2-5 

beta  bounds,  2-7,  2-16,  2-23 
cumulative  hazard,  2-7 
K-S  bounds,  2-6,  2-13,  2-19,  2-22,  2-27, 
2-32 
Poisson 

distribution,  2-50,  2-56 
analytic  estimation,  2-50 
process,  10-2 

nonhomogeneous,  10-2 
See  also:  Poisson  distribution 
Producer  risk,  3-5 
Progressive  stress.  See:  Step  stress 

R 

Radiography,  8-2 
electrons,  8-4 
gamma  radiation,  8-2,  8-4 
nuclear  radiation,  8-4,  8-5 
X rays,  8-2,  8-4 
Regression  analysis,  2-94 
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Reliability 
growth,  10-1 

Duane  model,  10-1 
inherent,  10-1 

measurement  tests.  See:  Testing,  physical 
measures,  3-4,  3-7 
reporting,  5-21 

failure-rate  compendia,  5-29 
historic  summaries,  5-23 
Replication,  2-78,  3-10 

S 


Sampling  plans 
multiple,  3-1 1,3-16 
sequential,  3-1 1,3-16,  3-24,  3-33,  3-34 
single,  3-11,3-16,  3-19,  3-28,  3-34 
Severity  level,  7-4,  7-6 
Small  samples,  2-36 
Statistical  concepts.  See:  Concepts 
Step  stress,  7-4 
Stress,  See:  Severity  level 
System  reliability  estimation 
from  subsystem  data,  2-109 


error,  9-3 

standardization,  9-2 
information,  5-13 
management.  See:  Test  program 
plans,  3-11, 3-15 
comparison,  3-15 
program,  1-1, 1-2,  3-7 
documentation,  4-2 
planning,  4-1 
procedures,  4-6 
reporting,  5-22 
schedules,  4-2 
Testing,  physical,  1-1, 2-3 
Thermal  evaluation,  8-5 
TR-7;  1-2 
Truncation,  3-1 5 


U 


Ultrasonic  evaluation,  8-9 
pulse  echo,  8-9 
resonance,  8-10 
transmission,  8-10 
Uncertainty,  experimental,  3-9 


T 

Terminology'  (testing),  3-3 
Test 

bias,  3-9 
criteria,  4-7 

MlL-STD-781;4-9 
equipment,  9-1 
calibration,  9-3 
computerized,  9-2 


V 

Variables  tests,  3-1 0 

W 

Weibull  distribution 

analytic  estimation,  2-63 
graphical  estimation,  2-18 
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